-- Logs begin at Wed 2022-05-25 15:14:11 UTC, end at Wed 2022-05-25 16:29:12 UTC. -- May 25 15:58:39.613328 dv-cinder-843277-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 15:58:39.620987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 15:58:39 2022] *** May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: nodename: dv-cinder-843277-2-iscsi May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: machine: x86_64 May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: clock source: unix May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: pcre jit disabled May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: detected number of CPU cores: 4 May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: current working directory: / May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: detected binary path: /usr/bin/uwsgi-core May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: your processes number limit is 47680 May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: your memory page size is 4096 bytes May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: detected max file descriptor number: 2048 May 25 15:58:39.622987 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: lock engine: pthread robust mutexes May 25 15:58:39.623972 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: thunder lock: enabled May 25 15:58:39.623972 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 15:58:39.623972 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 15:58:39.668289 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: Python main interpreter initialized at 0x5628a777f9c0 May 25 15:58:39.668289 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: python threads support enabled May 25 15:58:39.668289 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: your server socket listen backlog is limited to 100 connections May 25 15:58:39.668289 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: your mercy for graceful operations on workers is 90 seconds May 25 15:58:39.668709 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: mapped 403077 bytes (393 KB) for 2 cores May 25 15:58:39.668709 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: *** Operational MODE: preforking *** May 25 15:58:39.668997 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: *** uWSGI is running in multiple interpreter mode *** May 25 15:58:39.668997 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: spawned uWSGI master process (pid: 103329) May 25 15:58:39.669211 dv-cinder-843277-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 15:58:39.670925 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: spawned uWSGI worker 1 (pid: 103330, cores: 1) May 25 15:58:39.670925 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: spawned uWSGI worker 2 (pid: 103331, cores: 1) May 25 15:58:39.670925 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 15:58:40.821202 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 15:58:40.821849 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 15:58:41.534492 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:58:41.534492 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: from cryptography.utils import int_from_bytes May 25 15:58:41.534981 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:58:41.534981 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: from cryptography.utils import int_from_bytes May 25 15:58:41.542640 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:58:41.542640 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: from cryptography.utils import int_from_bytes May 25 15:58:41.542973 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:58:41.542973 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: from cryptography.utils import int_from_bytes May 25 15:58:44.074910 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:58:44.075512 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:58:44.075674 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:58:44.076054 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:58:44.076307 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:58:44.076687 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.077002 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.077323 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.077633 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.077954 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.078258 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.078575 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.078868 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.078982 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:58:44.079362 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:58:44.079453 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.079453 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.079685 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:58:44.079783 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.080091 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:58:44.080184 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-2-iscsi {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.080344 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:58:44.080456 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.080691 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.080809 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.081003 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.081104 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.081303 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.081446 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.081599 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.081706 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.081913 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.082030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.082215 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.082314 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.082581 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.082707 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.082900 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.083907 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084004 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084073 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084164 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084235 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084307 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084373 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084444 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-2-iscsi {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084523 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084590 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084664 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084732 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.084981 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.085078 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.085283 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.085370 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.085592 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.085676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.085893 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.085991 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.086203 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.086297 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-2-iscsi {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.086581 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.086710 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.086890 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.087021 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.087198 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.087313 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.087605 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.087720 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.087937 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.088026 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.088244 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.088337 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.088555 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.088650 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.088869 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.088955 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.089171 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.089264 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.089487 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.089592 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.089794 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.089893 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.090104 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.090202 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-2-iscsi {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.090417 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.090513 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.090715 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.090810 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.091019 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.091105 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.091336 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.091460 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.091641 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.091782 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.092014 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.092105 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.092318 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.092415 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.092584 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.092705 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.092850 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.093009 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.093165 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.093335 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.093479 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.093650 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.093794 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.093966 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.094053 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.094278 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.094365 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.094579 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.094668 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.094885 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.094979 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.095186 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.095280 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.095542 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.095643 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.095861 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.095965 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.096166 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.096253 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.096418 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.096518 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.096726 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.096823 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.097038 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.097124 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.097341 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.097479 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.097653 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.097753 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.097901 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.097988 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.098149 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.098263 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.098463 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.098551 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.098779 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.098874 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.099083 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.099221 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.099387 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.099475 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.099690 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.099776 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.100018 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.100111 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.100321 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.100462 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.100622 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.100710 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.100924 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.101019 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.101228 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.101316 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.101546 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.101654 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.101855 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.101951 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.102165 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.102250 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.102466 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.102553 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.102781 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.102882 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.103078 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.103163 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.103325 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.103412 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.103626 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.103732 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.103956 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.104051 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.104271 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.104369 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.104572 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.104659 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.104875 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.104961 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.105177 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.105263 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.105473 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.105561 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.105775 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.105861 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.106077 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.106175 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.106378 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.106474 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.106679 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.106766 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.106979 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.107064 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.107254 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.107349 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.107554 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.107650 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.107875 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.107965 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.108178 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.108272 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.108482 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.108567 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.108784 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.108879 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.109083 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.109169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.109378 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.109470 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.109677 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.109784 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.109978 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.110075 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.110279 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.110365 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.110581 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.110683 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.110879 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.110973 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.111205 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.111298 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.111526 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.111662 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.111807 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.111958 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.112136 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.112222 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.112436 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.112571 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.112735 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.112823 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.113044 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.113136 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.113337 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.113435 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.113637 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.113724 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.113940 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.114028 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.114236 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.114330 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.114539 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.114632 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.114837 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.114923 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.115134 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.115230 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.115433 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.115520 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.115731 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.115841 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.116053 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.116141 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.116350 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.116444 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.116646 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.116732 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.116959 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.117047 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.117257 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.117347 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.117557 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.117691 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.117859 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.117947 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.118157 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.118245 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.118456 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.118541 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.118757 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.118846 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.119060 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.119154 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.119364 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.119464 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.119666 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.119759 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.119989 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.120079 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.120296 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.120395 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.120593 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.120689 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.120912 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.120999 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.121217 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.121313 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.121521 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.121608 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.121821 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.121902 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.122128 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.122224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.122446 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:58:44.122533 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.122755 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.122843 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.123071 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.123167 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.123393 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.123481 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.123705 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.123791 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.124043 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.124132 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.124357 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.124445 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.124663 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.124757 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.124977 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.125065 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.125287 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.125388 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.125603 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.125696 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.125908 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.126004 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.126212 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.126298 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.126522 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.126608 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.126885 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.126974 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.127200 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.127288 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.127525 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.127613 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.127843 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.127932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.128159 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.128257 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.128464 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.128560 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.128769 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.128856 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.129084 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.129171 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.129394 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.129489 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.129709 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.129803 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.130013 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.130100 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.130316 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.130410 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.130619 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.130718 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.130925 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.131012 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.131226 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.131322 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.131559 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.131647 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.131887 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.131976 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.132200 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.132288 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.132507 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.132629 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.132817 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.132906 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.133120 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.133209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.133423 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.133515 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.133731 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.133819 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.134031 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.134119 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.134328 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.134433 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.134627 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.134714 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.134928 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.135016 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.135224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.135318 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.135535 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.135635 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.135869 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.135959 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.136186 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.136285 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.136496 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.136595 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.136812 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.136899 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.137118 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.137213 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.137427 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.137523 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.137731 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.137816 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.138030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.138119 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.138331 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.138427 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.138631 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.138718 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.138929 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.139014 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.139227 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.139322 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.139546 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.139650 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.139860 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.139993 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.140181 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.140269 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.140479 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.140564 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.140778 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.140865 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.141087 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.141177 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.141392 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.141479 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.141693 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.141780 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.141997 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.142091 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.142375 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.142526 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.142670 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.142882 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.143071 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.143228 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.143373 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.143522 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.143658 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.143911 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.144029 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.144114 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.144194 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.144274 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.144477 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.144581 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.144779 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.144868 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.145089 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.145177 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.145394 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.145491 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.145698 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.145850 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.145996 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.146137 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.146297 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.146444 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.146593 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.146739 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.146893 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.147053 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.147195 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.147283 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.147413 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.147501 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.147711 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.147840 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.148113 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.148267 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.148413 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.148500 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.148728 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.148824 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.149031 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.149119 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.149332 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.149419 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.149631 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.149727 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.149928 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.150015 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.150228 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.150314 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.150531 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.150635 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.150836 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.150924 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.151137 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.151224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.151439 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.151535 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.151744 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.151899 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.152077 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.152173 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.152380 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.152521 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.152689 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.152776 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.153001 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.153214 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.153375 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.153516 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.153662 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.153809 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.153950 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.154105 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.154274 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.154423 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.154581 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.154731 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.154877 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.155034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.155197 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.155353 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.155447 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.155528 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.155652 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.155741 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.155984 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.156075 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.156296 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.156383 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.156628 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.156715 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.156938 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.157026 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.157246 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.157333 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.157554 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.157650 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.157924 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.158029 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.158233 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.158365 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.158534 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.158732 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.158835 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.158918 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.159125 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.159213 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.159436 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.159533 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.159760 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.159917 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.160076 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.160181 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.160388 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.160488 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.160689 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.160783 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.161003 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.161091 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.161307 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.161396 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.161619 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.161713 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.161918 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.162007 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.162225 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.162313 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.162542 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.162628 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.162852 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.162940 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.163159 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.163321 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.163471 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.163615 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.163762 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.163950 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.164119 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.164283 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.164426 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.164566 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.164704 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.164843 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.165016 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.165172 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.165299 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.165385 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.165581 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.165882 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.165971 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.166193 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.166281 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.166498 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.166586 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.166801 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.166889 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.167098 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.167186 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.167413 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.167565 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.167727 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.167941 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.168092 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.168238 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.168386 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.168563 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.168721 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.168861 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.169067 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.169213 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.169352 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.169529 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.169614 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.169694 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.169787 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.169876 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.170082 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.170180 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.170380 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.170469 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.170679 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.170765 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.170983 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.171078 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.171282 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.171370 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.171579 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.171701 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.171904 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.172060 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.172198 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.172323 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.172520 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.172733 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.172896 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.173052 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.173141 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.173222 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.173500 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.173745 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.173846 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.174056 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.174144 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.174368 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.174455 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.174673 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.174771 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.174977 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.175073 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.175276 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.175361 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.175577 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.175677 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.175888 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.175975 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.176195 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.176284 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.176501 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.176589 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.176805 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.176899 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.177108 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.177341 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.177511 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.177665 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.177823 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.177971 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.178152 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.178300 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.178464 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.178617 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.178780 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.178925 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.179103 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.179272 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.179446 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.179590 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.179728 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.180133 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.180265 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.180490 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.180822 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.180909 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.181174 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.181261 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.181482 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.181583 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.181793 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.181882 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.182112 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.182208 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.182439 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.182537 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.182749 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.182837 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.183086 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.183181 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.183391 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.183658 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.183754 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.184013 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.184112 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.184314 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.184400 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.184619 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.184719 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.184922 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.185010 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.185223 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.185313 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.185522 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.185619 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.185924 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.186126 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.186215 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.186426 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.186522 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.186724 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.186811 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.187022 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.187109 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.187330 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.187429 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.187630 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.187725 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.187955 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.188046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.188255 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.188352 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.188556 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.188645 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.188861 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.188946 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.189181 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.189278 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.189480 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.189567 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.189778 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.189872 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.190077 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.190172 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.190390 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.190478 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.190692 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.190780 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.191000 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.191089 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.191301 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.191389 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.191957 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.192066 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.192269 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.192357 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.192568 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.192654 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.192870 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.192964 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.193166 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.193253 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.193465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.193597 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.193770 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.193858 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.194076 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.194166 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.194375 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.194462 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.194679 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.194775 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.194983 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.195077 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.195288 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.195366 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.195590 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.195733 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.195909 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.195988 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.196216 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.196303 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.196515 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.196618 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.196822 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.196908 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.197127 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.197212 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.197426 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.197521 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.197720 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.197808 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.198024 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.198119 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.198324 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.198412 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.198621 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.198721 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.198922 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.199008 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.199216 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.199309 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.199520 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.199605 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.199857 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.199958 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.200138 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.200227 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.200435 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.200522 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.200735 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.200823 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.201036 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.201123 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.201331 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.201417 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.201626 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.201725 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.201941 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.202026 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.202238 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.202324 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.202534 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.202668 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.202834 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.202922 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.203127 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.203213 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.203423 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.203520 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.203728 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.203840 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.204058 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.204144 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.204360 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.204462 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.204704 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.204814 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.205014 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.205101 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.205315 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.205411 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.205611 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.205743 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.205910 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.206005 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.206209 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.206297 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.206503 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.206598 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.206800 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.206887 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.207098 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.207186 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.207393 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.207487 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.207689 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.207775 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.208021 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.208109 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.208323 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.208417 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.208620 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.208716 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.208919 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.209004 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.209216 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.209301 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.209514 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.209609 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.209816 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.209904 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.210116 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.210202 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.210415 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.210510 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.210714 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.210809 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.211032 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.211120 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.211335 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.211432 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.211634 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.211730 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.211965 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.212053 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.212268 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.212357 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.212579 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.212673 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.212884 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.212970 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.213192 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.213290 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.213490 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.213586 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.213790 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.213876 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.214103 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.214190 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.214407 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.214502 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.214712 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.214799 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.215025 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.215120 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.215342 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.215436 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.215650 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.215743 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.215972 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.216061 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.216279 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.216365 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.216579 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.216682 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.216879 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.216974 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.217179 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.217264 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.217481 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.217576 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.217781 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.217869 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.218081 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.218166 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.218385 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.218482 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.218692 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.218827 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.218990 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.219076 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.219291 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.219386 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.219593 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.219681 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.219926 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.220015 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.220244 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.220334 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.220561 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.220655 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.220872 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.220967 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.221178 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.221266 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.221486 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.221572 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.221794 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.221919 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.222086 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.222169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.222380 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.222475 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.222685 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.222806 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.222989 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.223109 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.223287 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.223411 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.223605 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.223700 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.223933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.224024 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.224233 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.224320 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.224538 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.224637 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.224840 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.224928 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.225146 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.225239 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.225446 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.225588 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.225877 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.225972 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.226182 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.226267 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.226485 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.226580 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.226783 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.226877 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.227079 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.227166 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.227382 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.227469 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.227691 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.227777 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.228024 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.228113 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.228323 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.228411 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.228622 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.228733 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.228934 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.229027 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.229231 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.229340 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.229544 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.229631 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.229930 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.230015 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.230228 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.230317 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.230533 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.230620 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.230849 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.230946 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.231148 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.231235 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.231448 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.231536 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.231747 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.231901 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.232097 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.232193 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.232398 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.232486 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.232715 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.232810 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.233021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.233106 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.233324 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.233412 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.233646 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.233741 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.233961 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.234098 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.234262 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.234403 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.234568 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.234706 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.234865 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.235023 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.235182 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.235341 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.235497 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.235662 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.235803 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.236040 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.236181 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.236353 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.236590 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.236679 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.236908 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.236997 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.237213 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.237300 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.237531 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.237672 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.237853 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.237941 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.238151 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.238238 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.238446 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.238533 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.238749 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.238837 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.239046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.239133 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.239344 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.239477 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.239661 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.239791 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.239988 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.240100 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.240294 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.240393 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.240598 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.240711 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.240900 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.241035 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.241198 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.241338 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.241495 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.241639 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.241812 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.241948 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.242112 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.242250 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.242429 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.242552 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.242737 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.242870 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.243055 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.243172 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.243370 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.243466 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.243668 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.243756 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.244022 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.244120 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.244327 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.244424 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.244626 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.244722 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.244925 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.245013 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.245223 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.245311 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.245557 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.245646 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.245857 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.245953 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.246170 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.246258 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.246488 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.246589 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.246794 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.246881 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.247101 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.247187 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.247409 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.247504 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.247713 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.247810 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.248041 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.248130 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.248343 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.248449 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.248662 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.248749 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.248960 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.249054 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.249256 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.249359 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.249562 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.249650 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.249866 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.249960 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.250164 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.250251 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.250461 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.250549 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.250762 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.250912 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.251057 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.251146 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.251353 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.251440 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.251678 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.251767 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.252020 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.252110 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.252320 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.252407 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.252637 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.252732 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.252939 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.253033 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.253234 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.253322 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.253532 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.253628 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.253829 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.253914 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.254127 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.254213 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.254426 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.254522 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.254728 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.254815 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.255047 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.255136 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.255347 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.255443 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.255663 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.255748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.255990 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.256078 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.256293 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.256397 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.256593 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.256681 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.256891 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.256987 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.257196 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.257283 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.257502 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.257589 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.257809 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.257895 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.258117 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.258205 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.258424 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.258511 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.258724 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.258811 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.259032 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.259121 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.259339 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.259426 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.259647 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.259733 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.259976 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.260197 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.260297 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.260529 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.260617 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.260842 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.260932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.261154 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.261243 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.261466 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.261553 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.261769 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.261857 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.262075 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.262160 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.262381 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.262469 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.262686 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.262773 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.262991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.263201 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.263331 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.263534 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.263623 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.263872 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.263965 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.264182 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.264270 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.264493 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.264582 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.264802 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.264890 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.265110 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.265208 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.265418 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.265511 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.265727 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.265815 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.266034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.266130 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.266340 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.266428 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.266663 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.266750 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.266970 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.267064 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.267330 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.267430 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.267641 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.267729 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.268009 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.268110 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.268319 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.268408 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.268631 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.268719 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.268947 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.269044 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.269252 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.269398 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.269555 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.269644 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.269869 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.269959 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.270178 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.270266 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.270492 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.270588 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.270806 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.270895 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.271115 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.271203 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.271421 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.271516 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.271729 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.271816 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.272065 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.272165 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.272374 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.272583 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.272672 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.272892 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.272988 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.273221 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.273318 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.273541 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.273630 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.273860 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.273948 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.274174 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.274275 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.274487 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.274575 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.274804 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.274891 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.275102 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.275263 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.275403 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.275622 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.275717 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.275960 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.276052 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.276293 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.276392 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.276608 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.276702 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.276913 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.277009 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.277210 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.277299 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.277523 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.277610 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.277826 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.277926 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.278134 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.278350 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.278438 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.278695 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.278782 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.279006 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.279094 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.279319 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.279442 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.279640 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.279735 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.279969 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.280057 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.280272 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.280359 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.280590 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.280695 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.280890 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.280984 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.281190 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.281416 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.281504 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.281765 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.281854 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.282078 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.282164 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.282377 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.282465 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.282682 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.282790 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.283006 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.283093 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.283303 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.283399 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.283609 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.283697 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.283929 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.284021 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.284243 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.284342 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.284541 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.284627 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.284839 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.284935 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.285136 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.285232 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.285437 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.285524 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.285734 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.285820 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.286030 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.286127 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.286327 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.286416 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.286623 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.286719 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.286924 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.287012 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.287216 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.287304 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.287516 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.287603 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.287811 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.287925 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.288135 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.288223 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.288435 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.288523 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.288736 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.288830 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.289040 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.289134 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.289344 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.289431 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.289647 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.289739 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.289958 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.290046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.290260 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.290347 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.290563 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.290650 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.290863 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.290950 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.291174 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.291306 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.291479 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.291576 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.291782 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.291928 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.292134 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.292435 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.292661 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.292754 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.292989 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.293083 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.293304 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.293411 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.293624 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.293748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.293948 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.294205 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.294306 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.294509 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.294608 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.294866 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.295035 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.295211 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.295488 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.295579 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.295812 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.296088 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.296180 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.296422 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.296524 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.296740 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.296844 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.297044 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.297148 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.297351 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.297452 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.297654 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.297751 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.297958 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.298047 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.298262 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.298373 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.298620 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.298764 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.299854 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.299959 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300048 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300121 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300189 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300256 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300324 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300391 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300467 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300538 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300538 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300668 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300737 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.300815 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.301448 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.301540 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.301618 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.301695 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.301773 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.301857 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.301928 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.301996 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.302396 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.302493 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.302573 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.302652 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.302902 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.302992 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.303153 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.303226 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.303443 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.303550 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.303752 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.303884 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.304080 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.304251 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.304408 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.304497 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.304720 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.304808 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.305029 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.305128 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.305337 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.305426 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.305646 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.305734 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.305960 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.306062 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.306286 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.306384 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.306593 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.306680 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.306897 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.306985 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.307206 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.307320 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.307530 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.307617 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.307886 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.307978 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.308215 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.308316 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.308532 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.308620 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.308834 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.308930 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.309133 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.309220 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.309433 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.309528 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.309743 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.309830 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.310055 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.310142 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.310360 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.310458 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.310661 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.310749 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.310960 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.311048 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.311264 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.311361 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.311563 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.311664 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.311890 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.311981 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.312193 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.312282 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.312492 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.312579 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.312797 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.312885 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.313094 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.313190 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.313393 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.313481 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.313692 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.313780 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.314010 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.314114 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.314311 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.314407 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.314608 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.314696 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.314910 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.315002 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.315206 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.315299 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.315505 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.315602 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.315804 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.315918 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.316127 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.316214 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.316426 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.316526 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.317073 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.317163 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.317376 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.317473 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.317677 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.317778 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.317981 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.318077 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.318283 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.318372 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.318585 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.318688 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.318885 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.318973 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.319187 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.319282 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.319487 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.319575 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.319804 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.319964 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.320137 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.320235 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.320455 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.320544 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.320758 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.320845 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.321066 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.321154 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.321373 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.321463 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.321680 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.321766 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.321982 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.322069 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.322287 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.322379 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.322611 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.322698 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.322918 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.323014 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.323220 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.323307 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.323540 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.323630 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.323867 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.323970 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.324180 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.324268 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.324488 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.324585 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.324791 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.324968 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.325098 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.325196 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.325405 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.325499 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.325713 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.325810 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.326022 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.326109 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.326323 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.326409 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.326627 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.326724 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.326937 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.327032 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.327246 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.327334 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.327551 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.327639 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.327892 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.327981 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.328198 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.328299 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.328504 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.328591 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.328817 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.328912 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.329124 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.329221 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.329436 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.329525 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.329805 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.329907 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.330121 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.330222 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.330435 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.330522 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.330743 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.330839 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.331042 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.331144 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.331281 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:58:44.331378 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.331670 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.332044 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.332358 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.332697 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.333023 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.333337 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.333646 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.333951 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:58:44.334192 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:58:44.388692 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Registered counter for database nova_api May 25 15:58:44.392066 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Registered counter for database nova_api May 25 15:58:44.410740 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:58:44.412425 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:58:44.417620 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:58:44.418957 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:58:44.473654 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.context [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f16370f5-a19e-47df-b046-12510f265b21(cell1) {{(pid=103330) load_cells /opt/stack/nova/nova/context.py:464}} May 25 15:58:44.475130 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.context [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f16370f5-a19e-47df-b046-12510f265b21(cell1) {{(pid=103331) load_cells /opt/stack/nova/nova/context.py:464}} May 25 15:58:44.477727 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:58:44.479226 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:58:44.479388 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:58:44.480104 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:58:44.480825 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:58:44.481601 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 15:58:44.482022 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:58:44.483549 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 15:58:44.484080 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Registered counter for database nova_cell0 May 25 15:58:44.485585 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Registered counter for database nova_cell0 May 25 15:58:44.488109 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Registered counter for database nova_cell1 May 25 15:58:44.489676 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Registered counter for database nova_cell1 May 25 15:58:44.495384 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:58:44.497058 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:58:44.500519 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:58:44.502394 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:58:44.503317 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:58:44.507878 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:58:44.508988 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:58:44.510349 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:58:44.647883 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Registered counter for database nova_cell0 May 25 15:58:44.650964 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Registered counter for database nova_cell0 May 25 15:58:44.655291 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:58:44.660483 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:58:44.660631 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:58:44.665182 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:58:44.990723 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:58:44.994430 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:58:44.997895 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:58:45.001778 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:58:45.335106 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:58:45.341078 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:58:45.343932 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:58:45.346323 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628a777f9c0 pid: 103331 (default app) May 25 15:58:45.348398 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 15:58:45.349583 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 May 25 15:58:45.349991 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 788 bytes} [Wed May 25 15:58:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 15:58:45.350127 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-4644c702-4c23-4bcc-b03e-e9d661ddbc9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:58:45.355314 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628a777f9c0 pid: 103330 (default app) May 25 16:00:03.053228 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:03.054245 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 25 16:00:03.054784 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 2/2] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:03.067283 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:03.068195 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell1:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:03.068888 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell0:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:03.069802 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:03.503047 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-9a104c6b-db7a-4a36-bcd7-5325ac37fc66 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:03.533985 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-9a104c6b-db7a-4a36-bcd7-5325ac37fc66 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.472253 May 25 16:00:03.534941 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1291 bytes} [Wed May 25 16:00:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:00:05.792257 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:05.793640 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-27f973b4-2049-4f4b-93ef-0065a5a5047b None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001852 May 25 16:00:05.799082 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 3/4] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:05.856967 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-7d9f3060-8cec-4499-996f-e46539f1f9fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:05.875304 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:00:05.875304 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 25 16:00:05.904597 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-7d9f3060-8cec-4499-996f-e46539f1f9fa admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103991 May 25 16:00:05.905421 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 2/5] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:00:05.918900 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=3 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:05.920226 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell1:SELECT=3 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:05.921290 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell0:SELECT=3 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:05.922118 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:06.130096 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-786e6dee-fb45-4366-88a9-a7d17e3f954e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:06.132698 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:00:06.132698 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: warnings.warn(msg) May 25 16:00:06.204863 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-786e6dee-fb45-4366-88a9-a7d17e3f954e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291524 May 25 16:00:06.205902 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 4/6] 10.222.0.85 () {64 vars in 1335 bytes} [Wed May 25 16:00:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:00:08.473582 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-7d9f3060-8cec-4499-996f-e46539f1f9fa admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:08.474540 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-7d9f3060-8cec-4499-996f-e46539f1f9fa admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 May 25 16:00:08.474989 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 3/7] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:08.595353 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-7f86a1b8-6c51-44ee-8f66-823a02ace99f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "rxtx_factor": 1.0}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:08.613810 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:00:08.613810 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: warnings.warn(msg) May 25 16:00:08.633227 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-7f86a1b8-6c51-44ee-8f66-823a02ace99f admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152024 May 25 16:00:08.633750 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 5/8] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:00:08.646154 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-15dbc771-4148-4b38-ac3e-a09ebf77b761 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:08.651034 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:00:08.651034 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 25 16:00:08.692625 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-15dbc771-4148-4b38-ac3e-a09ebf77b761 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050375 May 25 16:00:08.693200 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 4/9] 10.222.0.85 () {64 vars in 1335 bytes} [Wed May 25 16:00:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:00:10.926824 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-7f86a1b8-6c51-44ee-8f66-823a02ace99f admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:10.927892 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-7f86a1b8-6c51-44ee-8f66-823a02ace99f admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 May 25 16:00:10.928832 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 6/10] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:10.994087 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-3f4e0673-1586-4f9a-86e2-fa2a586e98fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "disk": 10, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:11.013364 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-3f4e0673-1586-4f9a-86e2-fa2a586e98fc admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077648 May 25 16:00:11.014238 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 5/11] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:00:11.025930 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-500c8be9-8389-48aa-8b81-78ad336e393e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:11.050122 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-500c8be9-8389-48aa-8b81-78ad336e393e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027835 May 25 16:00:11.051231 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 7/12] 10.222.0.85 () {64 vars in 1335 bytes} [Wed May 25 16:00:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:00:13.334657 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-3f4e0673-1586-4f9a-86e2-fa2a586e98fc admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:13.335849 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-3f4e0673-1586-4f9a-86e2-fa2a586e98fc admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 May 25 16:00:13.336329 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 6/13] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:13.400366 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ba176a2f-2e9f-4c79-9d17-5f9c09ac05e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:13.420429 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-ba176a2f-2e9f-4c79-9d17-5f9c09ac05e9 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077334 May 25 16:00:13.421115 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 8/14] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 16:00:13.433436 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-f59c9d81-d9f5-4f36-bb1f-e238f274af39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:13.458605 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-f59c9d81-d9f5-4f36-bb1f-e238f274af39 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029047 May 25 16:00:13.459361 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 7/15] 10.222.0.85 () {64 vars in 1335 bytes} [Wed May 25 16:00:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:00:15.709214 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ba176a2f-2e9f-4c79-9d17-5f9c09ac05e9 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:15.710230 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-ba176a2f-2e9f-4c79-9d17-5f9c09ac05e9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 25 16:00:15.710634 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 9/16] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:15.771693 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-74ff79a9-4509-40ed-ad87-3f4945534fa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "name": "ds4G", "disk": 20, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:15.793403 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-74ff79a9-4509-40ed-ad87-3f4945534fa6 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076790 May 25 16:00:15.794247 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 8/17] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 16:00:15.805760 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-6c0a4b96-7fe7-4dc9-a5a2-45719d059716 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:15.829754 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-6c0a4b96-7fe7-4dc9-a5a2-45719d059716 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027585 May 25 16:00:15.843894 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 10/18] 10.222.0.85 () {64 vars in 1335 bytes} [Wed May 25 16:00:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:00:18.082379 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-74ff79a9-4509-40ed-ad87-3f4945534fa6 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:18.084370 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-74ff79a9-4509-40ed-ad87-3f4945534fa6 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002604 May 25 16:00:18.084983 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 9/19] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:18 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:18.149016 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-708157bb-f87f-4dde-b9d6-5097e4f30a05 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:18.172021 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-708157bb-f87f-4dde-b9d6-5097e4f30a05 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080056 May 25 16:00:18.172555 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 11/20] 10.222.0.85 () {60 vars in 1291 bytes} [Wed May 25 16:00:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:00:20.399369 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-74ff79a9-4509-40ed-ad87-3f4945534fa6 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:20.400436 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-74ff79a9-4509-40ed-ad87-3f4945534fa6 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 25 16:00:20.400813 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 10/21] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:20.461645 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-fb55956c-7dea-45b9-b755-10a2806d4e1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "disk": 1, "ram": 512, "swap": 0, "id": "1"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:20.481007 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-fb55956c-7dea-45b9-b755-10a2806d4e1f admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074097 May 25 16:00:20.481551 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 12/22] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:00:20.493675 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-a4cbe2c5-22a8-42b1-be26-ba5c8b0c4e05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:20.522266 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-a4cbe2c5-22a8-42b1-be26-ba5c8b0c4e05 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032165 May 25 16:00:20.522995 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 11/23] 10.222.0.85 () {64 vars in 1332 bytes} [Wed May 25 16:00:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:00:22.753747 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-fb55956c-7dea-45b9-b755-10a2806d4e1f admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:22.754875 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-fb55956c-7dea-45b9-b755-10a2806d4e1f admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 May 25 16:00:22.755248 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:22.816967 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-01039f4d-87ab-478e-aa48-a416ffebd6a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:22.837406 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-01039f4d-87ab-478e-aa48-a416ffebd6a9 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076075 May 25 16:00:22.837966 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 12/25] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:00:22.849904 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-defe58c2-d164-4da1-bae9-efc823ea0d70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:22.873721 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-defe58c2-d164-4da1-bae9-efc823ea0d70 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027483 May 25 16:00:22.874293 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 14/26] 10.222.0.85 () {64 vars in 1332 bytes} [Wed May 25 16:00:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:00:25.117619 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-01039f4d-87ab-478e-aa48-a416ffebd6a9 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:25.118645 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-01039f4d-87ab-478e-aa48-a416ffebd6a9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 25 16:00:25.119046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 13/27] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:25.181049 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-4e68713e-c02a-4f11-86cd-e170a9a3f994 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "vcpus": 2, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:25.203212 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-4e68713e-c02a-4f11-86cd-e170a9a3f994 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077888 May 25 16:00:25.203763 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 15/28] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:00:25.215798 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-485ed55f-80d4-461e-bb4e-11e582682f1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:25.239496 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-485ed55f-80d4-461e-bb4e-11e582682f1d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027570 May 25 16:00:25.240397 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 14/29] 10.222.0.85 () {64 vars in 1332 bytes} [Wed May 25 16:00:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:00:27.461055 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-4e68713e-c02a-4f11-86cd-e170a9a3f994 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:27.462072 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-4e68713e-c02a-4f11-86cd-e170a9a3f994 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 25 16:00:27.462469 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 16/30] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:27.519351 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-0fd3a84e-da81-4f61-b39a-22e6e50af779 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:27.538026 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-0fd3a84e-da81-4f61-b39a-22e6e50af779 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069456 May 25 16:00:27.538588 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 15/31] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 16:00:27.550621 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d1108d68-0ea8-4018-aa5f-9a0266250cc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:27.574990 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-d1108d68-0ea8-4018-aa5f-9a0266250cc4 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028088 May 25 16:00:27.575549 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 17/32] 10.222.0.85 () {64 vars in 1332 bytes} [Wed May 25 16:00:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:00:29.824837 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-0fd3a84e-da81-4f61-b39a-22e6e50af779 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:29.825861 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-0fd3a84e-da81-4f61-b39a-22e6e50af779 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 25 16:00:29.826257 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 16/33] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:29.891972 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-8776f1ea-6137-4b5d-ace8-69d3c66cd9dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:29.911176 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-8776f1ea-6137-4b5d-ace8-69d3c66cd9dd admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078988 May 25 16:00:29.918668 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 18/34] 10.222.0.85 () {64 vars in 1282 bytes} [Wed May 25 16:00:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 16:00:29.928190 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-dbcf0f8a-78c6-4bbd-8087-fa7544826d07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:29.953200 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-dbcf0f8a-78c6-4bbd-8087-fa7544826d07 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033236 May 25 16:00:29.953793 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 17/35] 10.222.0.85 () {64 vars in 1332 bytes} [Wed May 25 16:00:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:00:54.154371 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-8776f1ea-6137-4b5d-ace8-69d3c66cd9dd admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:54.155384 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-8776f1ea-6137-4b5d-ace8-69d3c66cd9dd admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 25 16:00:54.155772 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 19/36] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:54.166480 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:54.217574 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c7976142-0db1-4d25-a471-921960482d14 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:54.234125 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-c7976142-0db1-4d25-a471-921960482d14 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072260 May 25 16:00:54.234649 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 18/37] 10.222.0.85 () {60 vars in 1291 bytes} [Wed May 25 16:00:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:00:55.234426 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-8776f1ea-6137-4b5d-ace8-69d3c66cd9dd admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:55.235441 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-8776f1ea-6137-4b5d-ace8-69d3c66cd9dd admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 25 16:00:55.235850 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 20/38] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:55.455476 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-92a20e3c-fbe9-431d-8e3c-80cf3b9bf808 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:55.461460 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.wsgi [None req-92a20e3c-fbe9-431d-8e3c-80cf3b9bf808 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-92a20e3c-fbe9-431d-8e3c-80cf3b9bf808 admin admin] Request method failure captured: May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Accept: application/json May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Accept-Encoding: gzip, deflate May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Connection: keep-alive May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Content-Length: 0 May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Host: 10.222.0.85 May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Openstack-Api-Version: compute 2.90 May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Openstack-System-Scope: None May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: User-Agent: python-novaclient May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Auth-Token: gAAAAABijlK3xI3FR8DiaWsNEfo-y9dfh3H79Mv6CF3ZrP_A3enak8gC5mhtq5k37Ec09FLGPvzdwL_rGyJy_jdqiBvjbFIKUt4o2t4qfrXRJW2sVym93ykFndspoIbEHi0Dd2W8bgp4TG4XTi_veTgMMa6_yj2vxPniV112TwxZevWGS7WgSmY May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Domain-Id: None May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Domain-Name: None May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Identity-Status: Confirmed May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Is-Admin-Project: True May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Domain-Id: default May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Domain-Name: Default May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Name: admin May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Role: member,admin,reader May 25 16:00:55.464764 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Roles: member,admin,reader May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12da861032034c60b092c703b1fe5e90", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12da861032034c60b092c703b1fe5e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Tenant: admin May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Tenant-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Tenant-Name: admin May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User: admin May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Domain-Id: default May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Domain-Name: Default May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Id: 7effefc613a44b799e8f81fc6a35b678 May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Name: admin May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: method: > May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: exception: Flavor 42 could not be found. May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: action_args: {'id': '42'} May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:00:55.466359 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:55.467465 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:55.469046 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-92a20e3c-fbe9-431d-8e3c-80cf3b9bf808 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:00:55.470348 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-92a20e3c-fbe9-431d-8e3c-80cf3b9bf808 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.088576 May 25 16:00:55.470348 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 19/39] 10.222.0.85 () {60 vars in 1190 bytes} [Wed May 25 16:00:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:00:55.476318 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5965e360-e8b3-4f2b-9e14-3192fd04dc09 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:55.479487 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:55.499060 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-5965e360-e8b3-4f2b-9e14-3192fd04dc09 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026434 May 25 16:00:55.499595 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 21/40] 10.222.0.85 () {60 vars in 1210 bytes} [Wed May 25 16:00:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:00:55.509581 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-95423429-12bf-4621-a3bc-c75e564c04a1 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:55.530572 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-95423429-12bf-4621-a3bc-c75e564c04a1 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024682 May 25 16:00:55.531092 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 20/41] 10.222.0.85 () {60 vars in 1210 bytes} [Wed May 25 16:00:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:00:55.543465 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d40ab067-8bc3-4547-9ea8-1547cd92981d admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:55.550192 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.wsgi [None req-d40ab067-8bc3-4547-9ea8-1547cd92981d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d40ab067-8bc3-4547-9ea8-1547cd92981d admin admin] Request method failure captured: May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Accept: application/json May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Accept-Encoding: gzip, deflate May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Connection: keep-alive May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Content-Length: 0 May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Host: 10.222.0.85 May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Openstack-Api-Version: compute 2.90 May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Openstack-System-Scope: None May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: User-Agent: python-novaclient May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Auth-Token: gAAAAABijlK3xI3FR8DiaWsNEfo-y9dfh3H79Mv6CF3ZrP_A3enak8gC5mhtq5k37Ec09FLGPvzdwL_rGyJy_jdqiBvjbFIKUt4o2t4qfrXRJW2sVym93ykFndspoIbEHi0Dd2W8bgp4TG4XTi_veTgMMa6_yj2vxPniV112TwxZevWGS7WgSmY May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Domain-Id: None May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Domain-Name: None May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Identity-Status: Confirmed May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Is-Admin-Project: True May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Domain-Id: default May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Domain-Name: Default May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Name: admin May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Role: member,admin,reader May 25 16:00:55.553512 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Roles: member,admin,reader May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12da861032034c60b092c703b1fe5e90", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12da861032034c60b092c703b1fe5e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Tenant: admin May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Tenant-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Tenant-Name: admin May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User: admin May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Domain-Id: default May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Domain-Name: Default May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Id: 7effefc613a44b799e8f81fc6a35b678 May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Name: admin May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: method: > May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: exception: Flavor 42 could not be found. May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: action_args: {'id': '42'} May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:00:55.555034 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:55.555933 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:55.556987 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d40ab067-8bc3-4547-9ea8-1547cd92981d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:00:55.558513 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-d40ab067-8bc3-4547-9ea8-1547cd92981d admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015563 May 25 16:00:55.558513 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 22/42] 10.222.0.85 () {60 vars in 1190 bytes} [Wed May 25 16:00:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:00:56.423141 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-95423429-12bf-4621-a3bc-c75e564c04a1 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:56.424736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-95423429-12bf-4621-a3bc-c75e564c04a1 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002219 May 25 16:00:56.425125 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 21/43] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:56.625080 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5ccc1487-c1f5-4837-bf96-724c5e465c52 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:56.634268 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.wsgi [None req-5ccc1487-c1f5-4837-bf96-724c5e465c52 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5ccc1487-c1f5-4837-bf96-724c5e465c52 admin admin] Request method failure captured: May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Accept: application/json May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Accept-Encoding: gzip, deflate May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Connection: keep-alive May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Content-Length: 0 May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Host: 10.222.0.85 May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Openstack-Api-Version: compute 2.90 May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Openstack-System-Scope: None May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: User-Agent: python-novaclient May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Auth-Token: gAAAAABijlK4n1LfIsPH3gKuGUR0XDPc9_lEGhHDO5zqjldiMQPT-Yt4joXn1pdzC47bvuZ9bJf1eRsDTlniq-1FdcZzhdAj0qhjVMw47q0BG7to3veqkiqPVDnFwS2xZsegC5ABS7BwldLzom92Kqkx-YJk1OL0HEuu_OBgkVOfHt4KVd2VW-4 May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Domain-Id: None May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Domain-Name: None May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Identity-Status: Confirmed May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Is-Admin-Project: True May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Domain-Id: default May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Domain-Name: Default May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Name: admin May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Role: member,admin,reader May 25 16:00:56.636748 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Roles: member,admin,reader May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12da861032034c60b092c703b1fe5e90", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12da861032034c60b092c703b1fe5e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Tenant: admin May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Tenant-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Tenant-Name: admin May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User: admin May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Domain-Id: default May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Domain-Name: Default May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Id: 7effefc613a44b799e8f81fc6a35b678 May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Name: admin May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: method: > May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: exception: Flavor 84 could not be found. May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: action_args: {'id': '84'} May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:00:56.638209 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:56.639030 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:56.640169 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5ccc1487-c1f5-4837-bf96-724c5e465c52 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:00:56.641215 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-5ccc1487-c1f5-4837-bf96-724c5e465c52 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070563 May 25 16:00:56.641215 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 23/44] 10.222.0.85 () {60 vars in 1190 bytes} [Wed May 25 16:00:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:00:56.651123 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-cd9080fd-b3ff-47d6-859e-749bb91b8a1c admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:56.671629 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-cd9080fd-b3ff-47d6-859e-749bb91b8a1c admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026016 May 25 16:00:56.672201 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 22/45] 10.222.0.85 () {60 vars in 1210 bytes} [Wed May 25 16:00:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:00:56.682044 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-84a28af1-e73d-48af-a3d1-978f9fc024cd admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:56.696118 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-84a28af1-e73d-48af-a3d1-978f9fc024cd admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017666 May 25 16:00:56.697002 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 24/46] 10.222.0.85 () {60 vars in 1210 bytes} [Wed May 25 16:00:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:00:56.705896 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-990218bc-34cf-45f4-9107-c51597ec678f admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:56.711524 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.wsgi [None req-990218bc-34cf-45f4-9107-c51597ec678f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-990218bc-34cf-45f4-9107-c51597ec678f admin admin] Request method failure captured: May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Accept: application/json May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Accept-Encoding: gzip, deflate May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Connection: keep-alive May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Content-Length: 0 May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Host: 10.222.0.85 May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Openstack-Api-Version: compute 2.90 May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Openstack-System-Scope: None May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: User-Agent: python-novaclient May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Auth-Token: gAAAAABijlK4n1LfIsPH3gKuGUR0XDPc9_lEGhHDO5zqjldiMQPT-Yt4joXn1pdzC47bvuZ9bJf1eRsDTlniq-1FdcZzhdAj0qhjVMw47q0BG7to3veqkiqPVDnFwS2xZsegC5ABS7BwldLzom92Kqkx-YJk1OL0HEuu_OBgkVOfHt4KVd2VW-4 May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Domain-Id: None May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Domain-Name: None May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Identity-Status: Confirmed May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Is-Admin-Project: True May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Domain-Id: default May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Domain-Name: Default May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Name: admin May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Role: member,admin,reader May 25 16:00:56.713106 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Roles: member,admin,reader May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12da861032034c60b092c703b1fe5e90", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12da861032034c60b092c703b1fe5e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Tenant: admin May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Tenant-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Tenant-Name: admin May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User: admin May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Domain-Id: default May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Domain-Name: Default May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Id: 7effefc613a44b799e8f81fc6a35b678 May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Name: admin May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: method: > May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: exception: Flavor 84 could not be found. May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: action_args: {'id': '84'} May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:00:56.714991 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:56.716398 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:56.717915 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-990218bc-34cf-45f4-9107-c51597ec678f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:00:56.719348 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-990218bc-34cf-45f4-9107-c51597ec678f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012157 May 25 16:00:56.719348 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 23/47] 10.222.0.85 () {60 vars in 1190 bytes} [Wed May 25 16:00:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:00:57.581475 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-84a28af1-e73d-48af-a3d1-978f9fc024cd admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:57.582536 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-84a28af1-e73d-48af-a3d1-978f9fc024cd admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 25 16:00:57.582931 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 25/48] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:00:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:57.783423 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-47b48881-79ec-4f2f-b8de-bd025e857163 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:57.789625 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.wsgi [None req-47b48881-79ec-4f2f-b8de-bd025e857163 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-47b48881-79ec-4f2f-b8de-bd025e857163 admin admin] Request method failure captured: May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Accept: application/json May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Accept-Encoding: gzip, deflate May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Connection: keep-alive May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Content-Length: 0 May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Host: 10.222.0.85 May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Openstack-Api-Version: compute 2.90 May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Openstack-System-Scope: None May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: User-Agent: python-novaclient May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Auth-Token: gAAAAABijlK5zCfpzUxNB7Ue7eQfVr0LpzizFrylkofh81-6RkPti8_6YaoHdsTzoKZtWjGoti7pqRQAq8xqp7SWSxG00atnNnhgGCK55ysWDYGG-uNt_yE3RQzx7nlL2hOjxMjAhcIwgj29Q2zU1tBvBmb1d6uujz2GMqPKLv8HS5QrncF4LSQ May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Domain-Id: None May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Domain-Name: None May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Identity-Status: Confirmed May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Is-Admin-Project: True May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Domain-Id: default May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Domain-Name: Default May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Project-Name: admin May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Role: member,admin,reader May 25 16:00:57.791224 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Roles: member,admin,reader May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12da861032034c60b092c703b1fe5e90", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12da861032034c60b092c703b1fe5e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Tenant: admin May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Tenant-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-Tenant-Name: admin May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User: admin May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Domain-Id: default May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Domain-Name: Default May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Id: 7effefc613a44b799e8f81fc6a35b678 May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: X-User-Name: admin May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: method: > May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: exception: Flavor 451 could not be found. May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: action_args: {'id': '451'} May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:00:57.792736 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:57.793676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 25 16:00:57.795021 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-47b48881-79ec-4f2f-b8de-bd025e857163 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:00:57.796428 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-47b48881-79ec-4f2f-b8de-bd025e857163 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.071525 May 25 16:00:57.796428 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 24/49] 10.222.0.85 () {60 vars in 1193 bytes} [Wed May 25 16:00:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:00:57.802545 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-766953af-9afa-40da-bd4f-0e3de233dac4 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:57.818249 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-766953af-9afa-40da-bd4f-0e3de233dac4 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019236 May 25 16:00:57.818704 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 26/50] 10.222.0.85 () {60 vars in 1210 bytes} [Wed May 25 16:00:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:00:57.828065 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:57.841518 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016933 May 25 16:00:57.842033 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 25/51] 10.222.0.85 () {60 vars in 1210 bytes} [Wed May 25 16:00:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:00:57.850947 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-2f527e9c-aa6f-45c8-a92a-f632c87d980d admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:57.856709 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.wsgi [None req-2f527e9c-aa6f-45c8-a92a-f632c87d980d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-2f527e9c-aa6f-45c8-a92a-f632c87d980d admin admin] Request method failure captured: May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Accept: application/json May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Accept-Encoding: gzip, deflate May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Connection: keep-alive May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Content-Length: 0 May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Host: 10.222.0.85 May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Openstack-Api-Version: compute 2.90 May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Openstack-System-Scope: None May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: User-Agent: python-novaclient May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Auth-Token: gAAAAABijlK5zCfpzUxNB7Ue7eQfVr0LpzizFrylkofh81-6RkPti8_6YaoHdsTzoKZtWjGoti7pqRQAq8xqp7SWSxG00atnNnhgGCK55ysWDYGG-uNt_yE3RQzx7nlL2hOjxMjAhcIwgj29Q2zU1tBvBmb1d6uujz2GMqPKLv8HS5QrncF4LSQ May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Domain-Id: None May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Domain-Name: None May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Identity-Status: Confirmed May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Is-Admin-Project: True May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Openstack-Nova-Api-Version: 2.90 May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Domain-Id: default May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Domain-Name: Default May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Project-Name: admin May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Role: member,admin,reader May 25 16:00:57.858207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Roles: member,admin,reader May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_12da861032034c60b092c703b1fe5e90", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/12da861032034c60b092c703b1fe5e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/12da861032034c60b092c703b1fe5e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Tenant: admin May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Tenant-Id: 12da861032034c60b092c703b1fe5e90 May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-Tenant-Name: admin May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User: admin May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Domain-Id: default May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Domain-Name: Default May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Id: 7effefc613a44b799e8f81fc6a35b678 May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: X-User-Name: admin May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: method: > May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: exception: Flavor 451 could not be found. May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: action_args: {'id': '451'} May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:00:57.859857 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:57.860932 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 25 16:00:57.862345 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-2f527e9c-aa6f-45c8-a92a-f632c87d980d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:00:57.863568 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-2f527e9c-aa6f-45c8-a92a-f632c87d980d admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012046 May 25 16:00:57.863568 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 27/52] 10.222.0.85 () {60 vars in 1193 bytes} [Wed May 25 16:00:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 16:00:58.727029 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:58.728198 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 25 16:00:58.728578 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 26/53] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:00:58.930848 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-94af4d1c-7583-4eea-bcaa-d94e928d65b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:00:58.951900 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-94af4d1c-7583-4eea-bcaa-d94e928d65b5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.088369 May 25 16:00:58.952436 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 28/54] 10.222.0.85 () {64 vars in 1235 bytes} [Wed May 25 16:00:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:00:59.829805 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:00:59.830820 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 25 16:00:59.831182 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 27/55] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:00:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:01:00.034793 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-cfe1e239-69fb-40c0-9774-598b34856de5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:01:00.054946 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-cfe1e239-69fb-40c0-9774-598b34856de5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.086913 May 25 16:01:00.055480 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 29/56] 10.222.0.85 () {64 vars in 1235 bytes} [Wed May 25 16:00:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:01:00.916069 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:01:00.917079 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 May 25 16:01:00.917491 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 28/57] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:01:01.108618 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-dc1b7de2-0443-4523-bd4f-ae61356da454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:01:01.128854 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-dc1b7de2-0443-4523-bd4f-ae61356da454 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.078176 May 25 16:01:01.129397 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 30/58] 10.222.0.85 () {64 vars in 1235 bytes} [Wed May 25 16:01:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:01:02.017418 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:01:02.018439 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 25 16:01:02.018835 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 29/59] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:01:02.213460 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-dec4ba75-c590-47f5-9aa9-53902453fa5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:01:02.234257 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-dec4ba75-c590-47f5-9aa9-53902453fa5b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.080072 May 25 16:01:02.234703 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 31/60] 10.222.0.85 () {64 vars in 1235 bytes} [Wed May 25 16:01:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:01:03.091111 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:01:03.092244 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 25 16:01:03.092676 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 30/61] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:01:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:01:03.293029 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ada7bf6d-0584-442b-8070-8add69b2c3bc admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:01:03.312732 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-ada7bf6d-0584-442b-8070-8add69b2c3bc admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075173 May 25 16:01:03.313265 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 32/62] 10.222.0.85 () {60 vars in 1202 bytes} [Wed May 25 16:01:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:02:04.579122 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:02:04.580083 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e5b032df-65b1-4d71-9af7-e3803aa84750 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 25 16:02:04.580473 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 31/63] 10.222.0.85 () {54 vars in 930 bytes} [Wed May 25 16:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:02:04.587778 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:04.644474 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-9d4cadaa-99c4-4db7-8d2e-c4abb2a52f3d admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:02:04.663504 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-9d4cadaa-99c4-4db7-8d2e-c4abb2a52f3d admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077136 May 25 16:02:04.664090 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 33/64] 10.222.0.85 () {60 vars in 1291 bytes} [Wed May 25 16:02:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:02:04.684517 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=14 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:04.688211 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-6b0e21d9-0516-484b-93fb-965ddfc6f8bd admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:02:04.696525 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-6b0e21d9-0516-484b-93fb-965ddfc6f8bd admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013441 May 25 16:02:04.697101 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 32/65] 10.222.0.85 () {60 vars in 1282 bytes} [Wed May 25 16:02:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:02:04.710968 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-48ace543-f756-43f9-b944-017409a16938 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:02:04.722760 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-48ace543-f756-43f9-b944-017409a16938 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017249 May 25 16:02:04.723471 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 34/66] 10.222.0.85 () {60 vars in 1285 bytes} [Wed May 25 16:02:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:02:04.734646 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:02:04.742313 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011161 May 25 16:02:04.742803 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 33/67] 10.222.0.85 () {60 vars in 1285 bytes} [Wed May 25 16:02:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:02:04.755255 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d9eb1159-53bb-4450-8c59-4bb4686ef4f0 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:02:04.763177 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-d9eb1159-53bb-4450-8c59-4bb4686ef4f0 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011452 May 25 16:02:04.763708 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 35/68] 10.222.0.85 () {60 vars in 1282 bytes} [Wed May 25 16:02:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:05:43.768668 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:05:43.769686 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 25 16:05:43.770065 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 34/69] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:05:43.926054 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=6 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:44.046863 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-66f6e06e-8951-472b-977b-31cad1280df1 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:05:44.048106 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:05:44.048106 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: warnings.warn(msg) May 25 16:05:44.050316 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-66f6e06e-8951-472b-977b-31cad1280df1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:05:44.050799 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-66f6e06e-8951-472b-977b-31cad1280df1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:05:44.051652 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-66f6e06e-8951-472b-977b-31cad1280df1 admin admin] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:05:44.052092 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-66f6e06e-8951-472b-977b-31cad1280df1 admin admin] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:05:44.086627 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-66f6e06e-8951-472b-977b-31cad1280df1 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.163503 May 25 16:05:44.087176 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 36/70] 10.222.0.85 () {60 vars in 1193 bytes} [Wed May 25 16:05:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:05:44.954271 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:05:44.955328 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 25 16:05:44.955741 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 35/71] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:05:45.149746 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-e9df2498-cd32-4b6a-8a0b-31ecb3a218aa admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:05:45.150940 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:05:45.150940 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: warnings.warn(msg) May 25 16:05:45.152228 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-e9df2498-cd32-4b6a-8a0b-31ecb3a218aa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:05:45.152685 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-e9df2498-cd32-4b6a-8a0b-31ecb3a218aa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:05:45.153448 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-e9df2498-cd32-4b6a-8a0b-31ecb3a218aa admin admin] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:05:45.153905 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-e9df2498-cd32-4b6a-8a0b-31ecb3a218aa admin admin] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:05:45.173785 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-e9df2498-cd32-4b6a-8a0b-31ecb3a218aa admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084398 May 25 16:05:45.174333 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 37/72] 10.222.0.85 () {60 vars in 1193 bytes} [Wed May 25 16:05:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:05:56.573093 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:05:56.574115 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 25 16:05:56.574560 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 36/73] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:05:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:05:56.718207 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell0:SELECT=4 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:56.719165 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell1:SELECT=4 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:56.719878 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=8 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:56.780313 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-3528cec4-41c2-442c-832f-16afa7012bbb admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:05:56.781498 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:05:56.781498 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: warnings.warn(msg) May 25 16:05:56.782685 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-3528cec4-41c2-442c-832f-16afa7012bbb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:05:56.783122 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-3528cec4-41c2-442c-832f-16afa7012bbb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:05:56.783931 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-3528cec4-41c2-442c-832f-16afa7012bbb admin admin] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:05:56.784363 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-3528cec4-41c2-442c-832f-16afa7012bbb admin admin] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:05:56.809288 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-3528cec4-41c2-442c-832f-16afa7012bbb admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.096332 May 25 16:05:56.809756 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 38/74] 10.222.0.85 () {60 vars in 1193 bytes} [Wed May 25 16:05:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:05:57.673371 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:05:57.674419 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-bb5030e0-8267-45e9-82d6-8cd30c7c1b90 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 25 16:05:57.674817 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 37/75] 10.222.0.85 () {56 vars in 1074 bytes} [Wed May 25 16:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:05:57.878836 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-54c0103e-1d6a-4135-b367-0992eadcb35e admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:05:57.879988 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:05:57.879988 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: warnings.warn(msg) May 25 16:05:57.881172 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-54c0103e-1d6a-4135-b367-0992eadcb35e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:05:57.881616 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-54c0103e-1d6a-4135-b367-0992eadcb35e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:05:57.882397 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-54c0103e-1d6a-4135-b367-0992eadcb35e admin admin] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:05:57.882824 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-54c0103e-1d6a-4135-b367-0992eadcb35e admin admin] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:05:57.904320 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-54c0103e-1d6a-4135-b367-0992eadcb35e admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086952 May 25 16:05:57.904858 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 39/76] 10.222.0.85 () {60 vars in 1193 bytes} [Wed May 25 16:05:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:07:00.007192 dv-cinder-843277-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 25 16:07:00.008646 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: Wed May 25 16:07:00 2022 - graceful shutdown triggered... May 25 16:07:00.009179 dv-cinder-843277-2-iscsi devstack@n-api.service[103330]: Gracefully killing worker 1 (pid: 103330)... May 25 16:07:00.009551 dv-cinder-843277-2-iscsi devstack@n-api.service[103331]: Gracefully killing worker 2 (pid: 103331)... May 25 16:07:01.009884 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: worker 1 buried after 1 seconds May 25 16:07:01.009884 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: worker 2 buried after 1 seconds May 25 16:07:01.009884 dv-cinder-843277-2-iscsi devstack@n-api.service[103329]: goodbye to uWSGI. May 25 16:07:01.012383 dv-cinder-843277-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 25 16:07:01.013320 dv-cinder-843277-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 25 16:07:01.017566 dv-cinder-843277-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 16:07:01.038869 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 16:07:01 2022] *** May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: nodename: dv-cinder-843277-2-iscsi May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: machine: x86_64 May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: clock source: unix May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: pcre jit disabled May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: detected number of CPU cores: 4 May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: current working directory: / May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: detected binary path: /usr/bin/uwsgi-core May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: your processes number limit is 47680 May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: your memory page size is 4096 bytes May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: detected max file descriptor number: 2048 May 25 16:07:01.064595 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: lock engine: pthread robust mutexes May 25 16:07:01.065680 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: thunder lock: enabled May 25 16:07:01.065680 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 16:07:01.065680 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 16:07:01.109591 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: Python main interpreter initialized at 0x55ecc3f9f9c0 May 25 16:07:01.109591 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: python threads support enabled May 25 16:07:01.109591 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: your server socket listen backlog is limited to 100 connections May 25 16:07:01.109591 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: your mercy for graceful operations on workers is 90 seconds May 25 16:07:01.110060 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: mapped 403077 bytes (393 KB) for 2 cores May 25 16:07:01.110060 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: *** Operational MODE: preforking *** May 25 16:07:01.110314 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: *** uWSGI is running in multiple interpreter mode *** May 25 16:07:01.110314 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: spawned uWSGI master process (pid: 117751) May 25 16:07:01.110497 dv-cinder-843277-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 16:07:01.111094 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: spawned uWSGI worker 1 (pid: 117763, cores: 1) May 25 16:07:01.111443 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: spawned uWSGI worker 2 (pid: 117764, cores: 1) May 25 16:07:01.112355 dv-cinder-843277-2-iscsi devstack@n-api.service[117751]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 16:07:02.295091 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 16:07:02.299542 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 16:07:03.083091 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:07:03.083091 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: from cryptography.utils import int_from_bytes May 25 16:07:03.083393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:07:03.083393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: from cryptography.utils import int_from_bytes May 25 16:07:03.086878 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:07:03.086878 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: from cryptography.utils import int_from_bytes May 25 16:07:03.087257 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:07:03.087257 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: from cryptography.utils import int_from_bytes May 25 16:07:05.472916 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:07:05.473542 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:07:05.473826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:07:05.474036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:07:05.474305 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:07:05.474718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.475018 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.475349 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.475701 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.476059 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.476377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.476704 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.477025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.477326 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.477594 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.477944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.478243 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-2-iscsi {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.478596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.478726 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:07:05.479106 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:07:05.479184 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.479184 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.479450 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:07:05.479577 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.479733 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:07:05.479866 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.480032 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:07:05.480160 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.480361 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.480460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.480859 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.481026 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.481199 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.481517 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.481846 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.482233 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.482459 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.482669 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.482892 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.483117 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.483323 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.483541 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.483758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.484040 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.484267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.484485 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.484698 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-2-iscsi {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.484906 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.485130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.485367 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.485617 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.485822 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.486036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.486253 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.486471 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.486687 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.486910 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.487118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-2-iscsi {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.487335 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.487335 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.487722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.487722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.488170 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.488170 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.488484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.488676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.488830 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.488975 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.489117 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.489293 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.489447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.489598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.489767 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.489934 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.490078 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.490227 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.490369 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.490637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.490804 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.490956 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.491113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.491258 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.491410 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.491570 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-2-iscsi {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.491721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.491941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.492097 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.492844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.493008 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.493162 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.493385 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.493535 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.493681 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.493833 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.494000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.494153 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.494308 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.494460 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.494618 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.494761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.494913 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.495074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.495227 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.495380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.495536 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.495695 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.495880 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.496046 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.496192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.496338 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.496500 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.496656 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.496847 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.497043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.497200 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.497346 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.497504 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.497649 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.497800 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.497952 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.498106 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.498257 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.498421 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.498572 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.498717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.498869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.499022 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.499174 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.499327 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.499480 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.499669 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.499875 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.500030 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.500188 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.500188 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.500483 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.500627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.500771 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.500916 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.501070 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.501224 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.501369 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.501511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.501660 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.501804 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.501957 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.502119 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.502271 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.503110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.503265 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.503435 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.503581 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.503725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.503885 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.504034 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.504178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.504342 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.504494 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.504647 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.504813 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.504970 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.505126 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.505280 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.505432 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.505576 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.505728 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.505873 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.506023 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.506182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.506333 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.506489 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.506643 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.506786 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.506939 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.507083 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.507228 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.507383 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.507526 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.507675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.507859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.508018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.508164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.508316 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.508469 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.508623 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.508782 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.508936 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.509080 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.509223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.509376 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.509527 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.509680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.509832 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.509983 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.510134 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.510284 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.510436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.510604 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.510749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.510892 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.511044 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.511187 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.511340 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.511493 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.511637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.511637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.511954 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.512109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.512271 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.512424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.513259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.513415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.513569 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.513724 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.513878 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.514030 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.514030 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.514311 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.514456 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.514599 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.514740 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.514882 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.515034 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.515197 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.515342 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.515485 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.515715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.515879 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.516110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.516260 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.516403 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.516554 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.516699 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.516852 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.517011 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.517167 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.517318 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.517470 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.517626 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.517776 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.517920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.518064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.518064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.518349 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.518494 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.518647 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.518805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.518956 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.519111 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.519338 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.519493 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.519645 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.519798 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.519986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.520139 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.520297 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.520441 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.520584 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.520735 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.520888 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.520888 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.521180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.521331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.521482 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.521634 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.521785 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.521944 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.522095 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.522246 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.522397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.522540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.522710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.523509 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.523661 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.523887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.524039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.524194 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.524347 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.524501 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.524652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.524803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.524954 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.525102 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.525102 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.525392 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.525538 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.525692 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.525844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.525995 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.526148 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.526300 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.526451 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:07:05.526602 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.526745 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.526888 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.527045 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.527192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.527334 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.527478 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.527639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.527801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.527987 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.528308 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.528539 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.528776 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.529011 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.529272 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.529508 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.529752 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.530004 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.530258 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.530537 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.530804 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.531047 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.531298 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.531545 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.531799 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.532089 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.532334 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.532596 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.532869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.533839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.533991 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.534147 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.534305 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.534786 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.534933 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.535086 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.535229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.535373 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.535518 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.535677 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.535897 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.536048 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.536193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.536348 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.536502 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.536659 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.536813 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.536966 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.537117 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.537262 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.537415 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.537572 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.537728 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.537883 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.538036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.538180 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.538333 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.538485 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.538642 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.538787 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.538930 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.539074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.539227 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.539399 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.539639 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.539940 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.540102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.540258 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.540403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.540547 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.540703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.540856 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.541008 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.541300 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.541458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.541610 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.541763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.541908 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.542060 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.542218 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.542371 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.542371 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.542644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.542814 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.542814 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.543128 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.543864 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.544111 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.544260 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.544418 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.544573 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.544718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.544870 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.545024 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.545024 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.545308 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.545477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.545477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.545752 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.545903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.545903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.546185 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.546340 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.546484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.546628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.546628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.546911 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.547056 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.547210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.547372 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.547517 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.547668 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.547851 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.548013 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.548170 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.548315 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.548474 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.548627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.548780 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.548933 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.549078 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.549231 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.549393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.549537 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.549680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.549906 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.550053 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.550198 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.550342 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.550484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.550628 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.550781 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.550925 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.551069 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.551224 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.551451 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.551608 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.551767 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.551947 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.552094 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.552246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.552393 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.552393 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.552687 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.552839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.552984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.553136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.553292 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.553986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.553986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.554396 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.554544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.554544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.554827 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.554988 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.554988 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.555273 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.555418 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.555418 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.555706 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.555932 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.556082 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.556227 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.556370 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.556523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.556794 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.556952 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.557106 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.557251 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.557402 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.557548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.557548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.557858 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.558005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.558156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.558308 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.558459 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.558614 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.558759 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.558902 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.559047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.559190 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.559441 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.559607 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.559762 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.559951 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.559951 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.560228 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.560385 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.560530 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.560676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.560820 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.560971 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.561125 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.561284 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.561449 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.561676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.561676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.561974 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.561974 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.562270 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.562270 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.562552 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.562696 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.562850 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.563004 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.563149 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.563301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.563446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.563981 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.564295 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.564561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.564713 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.564867 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.565038 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.565196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.565341 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.565495 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.565640 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.565791 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.565945 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.566098 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.566251 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.566404 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.566568 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.566713 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.566858 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.567003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.567155 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.567309 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.567462 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.567607 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.567607 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.567960 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.568121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.568274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.568442 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.568587 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.568730 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.568874 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.569026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.569180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.569333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.569484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.569629 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.569773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.569925 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.570070 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.570225 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.570388 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.570533 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.570533 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.570828 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.570979 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.571131 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.571287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.571433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.571586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.571837 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.572007 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.572152 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.572296 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.572450 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.572612 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.572757 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.572901 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.573044 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.573187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.573333 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.573485 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.573637 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.574214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.574548 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.574781 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.574964 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.575134 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.575280 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.575425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.575569 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.575713 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.575884 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.576057 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.576210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.576362 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.576507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.576650 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.576807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.576959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.577122 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.577274 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.577428 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.577573 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.577728 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.577881 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.578033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.578185 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.578337 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.578490 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.578648 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.578791 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.578945 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.579088 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.579234 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.579377 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.579528 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.579674 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.579833 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.579984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.580139 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.580363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.580510 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.580662 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.580807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.580960 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.581114 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.581277 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.581423 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.581575 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.581728 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.581957 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.582113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.582272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.582416 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.582559 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.582714 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.582857 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.583019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.583019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.583301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.583446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.583597 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.583742 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.584272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.584453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.584776 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.585021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.585178 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.585332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.585332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.585648 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.585648 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.585944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.586103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.586255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.586413 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.586572 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.586723 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.586880 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.587034 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.587184 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.587351 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.587511 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.587511 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.587809 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.588147 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.588314 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.588473 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.588623 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.588782 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.588932 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.588932 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.589228 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.589387 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.589545 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.589715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.589875 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.590027 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.590186 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.590337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.590520 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.590752 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.590906 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.591066 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.591263 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.591502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.591739 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.592009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.592381 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.592680 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.592958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.593209 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.593458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.593458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.593458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.595052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.595052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.595710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.596029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.596270 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.596505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.596779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.597018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.597224 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.597394 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.597550 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.597718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.597879 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.598040 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.598199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.598358 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.598512 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.598671 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.598846 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.599006 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.599171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.599331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.599492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.599651 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.599811 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.600000 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.600151 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.600302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.600460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.600613 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.600773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.600944 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.601104 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.601255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.601405 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.601555 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.601719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.601878 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.602037 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.602196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.602447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.602613 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.602778 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.602937 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.603099 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.603249 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.603401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.603560 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.603713 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.603907 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.604064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.604214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.604829 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.605118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.605411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.605685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.605853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.606013 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.606157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.606292 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.606408 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.606635 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.606798 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.607716 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.607900 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.608059 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.608224 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.608386 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.608559 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.608720 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609135 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609305 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609459 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609664 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.609819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.610801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.610801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.610801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.610801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.610801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.610801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.610801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.610801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.611616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.611616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.611616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.611616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.612446 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.612705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.612705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.612705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.612705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.612705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.612705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.612705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.613724 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.613883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.614083 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.614285 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.614480 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.615160 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.615423 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.615711 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.615711 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.616186 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.616347 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.616521 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.616674 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.616826 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.616985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.617145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.617298 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.617477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.617631 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.617782 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.617940 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.618092 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.618252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.618252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.618550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.618700 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.618700 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.618994 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.619161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.619337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.619337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.619644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.619644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.620036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.620205 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.620357 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.620509 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.620662 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.620777 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.621191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.621348 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.621465 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.621578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.621690 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.621921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.621921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.622238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.622369 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.622496 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.622625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.622856 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.623067 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.623192 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.623311 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.623425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.623554 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.623646 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.623735 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.623848 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.623939 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.624026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.624164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.624261 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.624358 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.624445 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.624532 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.624625 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.624741 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.625035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.625277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.625277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.625277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.625277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.625277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.625277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.625277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.625277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.626343 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.626343 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.626521 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.626623 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.626718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.626814 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.626814 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.626980 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627068 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627163 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627250 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627250 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627416 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627504 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627699 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627789 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.627923 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628010 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628110 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628207 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628450 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628545 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628632 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628812 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.628906 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629001 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629430 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629531 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629619 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629713 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629801 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.629985 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630080 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630253 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630338 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630701 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630786 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630786 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.630953 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631049 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631222 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631307 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631492 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631492 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631659 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631659 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631804 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.631952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632056 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632145 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632239 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632340 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632538 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632633 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632834 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.632968 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633059 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633154 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633250 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633337 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633521 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633746 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633874 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.633994 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.634106 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.634217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.634334 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.634441 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.634530 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.634624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.634711 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.634797 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.634897 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.635050 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.635186 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.635404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.635501 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.635604 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.635702 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.635791 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.635928 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.636018 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.636113 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.636398 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.636501 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.636597 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.636693 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.636788 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.636875 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.636968 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.637070 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.637240 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.637354 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.637573 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.637681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.637880 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.637984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.638195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.638296 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.638512 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.638607 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.638833 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.638965 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.639141 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.639287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.639462 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.639595 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642206 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642319 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642411 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642510 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642608 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642714 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642971 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.642971 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643199 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643289 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643377 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643463 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643902 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.643984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644115 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644216 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644316 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644404 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644489 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644581 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644675 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644675 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644840 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.644927 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.645013 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.645148 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.645268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.645268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.645577 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.645681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.645783 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.645875 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.645981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.646063 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.646344 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.646630 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.646931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.647234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.647454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.647547 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.647785 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.647892 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.648128 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.648231 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.648447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.648567 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.650117 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.650926 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.651078 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.651195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.651308 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.651421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.651542 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.651654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.651780 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.651962 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652517 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652605 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652705 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.652998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.653113 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.653249 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.653352 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.653440 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.653540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.653629 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.653715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.653866 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.654035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.654189 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.654353 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.654521 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.654674 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.654854 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.654986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.655169 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.655374 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.655512 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.655634 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.655883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.655984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.656295 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.656407 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.656698 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.656791 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.657030 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.657125 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.657368 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.657494 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.657603 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.657724 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.657919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.658057 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.658306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.658408 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.658614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.658709 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.658919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.659024 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.659229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.659325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.659914 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.660025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.660234 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.660344 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.660540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.660642 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.660851 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.660945 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.661155 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.661258 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.661460 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.661561 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.661763 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.661858 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.662065 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.662169 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.662368 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.662473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.662673 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.662768 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.662990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.663084 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.663302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.663404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.663623 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.663718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.663965 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.664073 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.664276 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.664374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.664609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.664702 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.664919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.665022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.665244 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.665390 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.665536 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.665648 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.665838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.665934 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.666173 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.666274 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.666510 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.666651 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.666839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.666972 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.667095 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.667190 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.667413 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.667569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.667722 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.667859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.668061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.668155 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.668377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.668547 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.668744 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.668856 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.669087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.669340 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.669480 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.669671 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.669791 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.669984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.670090 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.670290 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.670394 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.670594 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.670688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.670897 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.670992 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.671198 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.671312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.671505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.671600 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.671805 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.671920 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.672126 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.672262 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.672460 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.672565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.672745 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.672849 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.673047 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.673143 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.673363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.673509 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.673668 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.673772 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.673970 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.674066 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.674275 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.674448 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.674574 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.674677 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.674905 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.675008 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.675204 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.675296 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.675533 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.675744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.675902 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.675998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.676176 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.676281 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.676497 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.676634 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.676801 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.676903 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.677106 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.677218 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.677419 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.677529 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.677729 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.677837 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.678039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.678135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.678350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.678453 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.678659 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.678754 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.679001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.679177 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.679345 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.679488 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.679626 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.679731 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.679964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.680060 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.680279 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.680382 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.680591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.680685 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.680914 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.681155 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.681264 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.681480 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.681740 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.681841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.682061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.682166 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.682380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.682510 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.682690 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.682797 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.682999 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.683109 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.683309 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.683405 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.683618 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.683721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.683955 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.684073 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.684285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.684391 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.684614 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.684710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.684933 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.685037 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.685254 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.685350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.685557 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.685651 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.685881 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.685979 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.686199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.686297 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.686502 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.686611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.686824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.686944 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.687134 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.687239 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.687504 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.687736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.687911 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.688019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.688146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.688340 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.688458 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.688687 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.688786 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.689013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.689118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.689331 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.689425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.689639 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.689743 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.689948 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.690041 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.690258 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.690387 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.690563 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.690684 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.690869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.690968 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.691176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.691281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.691482 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.691588 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.691789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.691904 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.692123 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.692241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.692433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.692527 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.692737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.692843 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.693050 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.693154 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.693354 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.693622 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.693779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.693935 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.694093 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.694236 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.694376 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.694557 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.694654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.694877 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.695001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.695187 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.695282 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.695490 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.695608 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.695803 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.695966 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.696126 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.696269 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.696430 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.696560 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.696730 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.696842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.697102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.697276 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.697403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.697538 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.697753 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.697881 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.697961 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.698187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.698302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.698536 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.698693 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.698846 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.698988 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.699133 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.699275 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.699468 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.699648 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.699790 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.700069 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.700180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.700385 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.700489 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.700790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.700887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.701099 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.701201 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.701420 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.701523 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.701726 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.701872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.702050 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.702305 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.702400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.702639 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.702743 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.702948 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.703044 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.703257 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.703360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.703598 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.703701 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.703930 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.704042 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.704237 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.704342 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.704544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.704646 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.704846 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.704942 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.705151 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.705255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.705453 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.705556 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.705762 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.705897 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.706071 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.706234 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.706373 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.706517 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.706672 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.706775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.706978 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.707100 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.707280 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.707392 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.707577 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.707680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.707912 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.708023 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.708199 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.708346 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.708500 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.708643 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.708805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.708952 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.709117 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.709214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.709445 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.709539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.709754 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.709851 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.710053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.710150 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.710356 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.710458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.710685 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.710780 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.710997 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.711091 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.711294 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.711397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.711594 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.711689 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.711931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.712074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.712240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.712393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.712557 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.712712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.712862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.712958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.713162 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.713275 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.713506 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.713600 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.713820 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.713922 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.714189 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.714343 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.714512 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.714671 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.714824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.714987 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.715147 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.715317 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.715478 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.715671 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.715813 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.716000 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.716167 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.716317 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.716479 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.716584 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.716810 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.716915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.717150 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.717261 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.717481 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.717592 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.717784 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.717901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.718088 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.718228 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.718447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.718610 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.718777 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.718931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.719073 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.719221 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.719362 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.719507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.719649 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.719798 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.719968 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.720078 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.720237 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.720388 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.720542 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.720701 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.720842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.720981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.721127 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.721266 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.721414 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.721553 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.721702 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.721850 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.721998 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.722162 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.722313 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.722491 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.722641 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.722787 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.722926 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.723073 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.723220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.723320 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.723440 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.723551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.723743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.723898 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.724074 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.724181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.724377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.724475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.724678 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.724786 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.724980 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.725082 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.725284 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.725388 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.725585 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.725693 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.725920 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.726021 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.726256 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.726371 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.726579 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.726688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.726893 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.726990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.727203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.727295 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.727519 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.727622 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.727839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.727935 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.728159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.728285 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.728481 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.728592 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.728795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.728907 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.729100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.729214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.729433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.729537 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.729735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.729845 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.730039 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.730151 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.730340 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.730451 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.730646 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.730756 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.730955 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.731068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.731312 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.731403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.731613 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.731719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.731950 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.732132 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.732296 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.732440 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.732584 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.732730 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.732882 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.733032 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.733174 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.733323 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.733427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.733515 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.733699 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.733810 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.733997 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.734113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.734298 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.734430 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.734597 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.734732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.734896 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.735044 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.735199 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.735356 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.735497 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.735667 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.735800 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.736015 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.736110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.736353 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.736518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.736649 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.736749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.736976 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.737078 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.737275 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.737369 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.737605 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.737727 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.737931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.738035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.738241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.738351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.738632 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.738778 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.738892 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.739006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.739170 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.739276 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.739473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.739573 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.739786 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.739928 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.740134 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.740231 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.740402 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:07:05.740503 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.740735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.741064 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.741371 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.741681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.741990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.742298 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.742603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.742909 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.743236 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.743558 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.743881 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.744206 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.744523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.744841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.745154 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.745463 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.745791 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.746099 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.746407 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.746740 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.747080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.747390 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.747707 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.748044 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.748370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.748693 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.748998 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.749320 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.749643 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.750036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.750298 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.750639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.750963 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.751273 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.751581 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.751907 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:07:05.752202 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117764) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:07:05.799980 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO dbcounter [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Registered counter for database nova_api May 25 16:07:05.810980 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO dbcounter [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Registered counter for database nova_api May 25 16:07:05.820404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_db.sqlalchemy.engines [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:07:05.828541 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writer thread running {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:07:05.830892 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_db.sqlalchemy.engines [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:07:05.838661 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writer thread running {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:07:05.884919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.context [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f16370f5-a19e-47df-b046-12510f265b21(cell1) {{(pid=117763) load_cells /opt/stack/nova/nova/context.py:464}} May 25 16:07:05.889235 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:07:05.890823 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:07:05.891632 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:07:05.893647 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:07:05.894893 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.context [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f16370f5-a19e-47df-b046-12510f265b21(cell1) {{(pid=117764) load_cells /opt/stack/nova/nova/context.py:464}} May 25 16:07:05.895614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO dbcounter [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Registered counter for database nova_cell0 May 25 16:07:05.899145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:07:05.899720 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO dbcounter [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Registered counter for database nova_cell1 May 25 16:07:05.900823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:07:05.901629 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:07:05.903706 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:07:05.905762 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO dbcounter [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Registered counter for database nova_cell0 May 25 16:07:05.907726 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_db.sqlalchemy.engines [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:07:05.909779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_db.sqlalchemy.engines [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:07:05.910347 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO dbcounter [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Registered counter for database nova_cell1 May 25 16:07:05.916021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writer thread running {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:07:05.917593 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_db.sqlalchemy.engines [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:07:05.917725 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writer thread running {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:07:05.919680 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_db.sqlalchemy.engines [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:07:05.925299 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writer thread running {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:07:05.927774 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writer thread running {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:07:06.063853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO dbcounter [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Registered counter for database nova_cell0 May 25 16:07:06.072479 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_db.sqlalchemy.engines [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:07:06.073791 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO dbcounter [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Registered counter for database nova_cell0 May 25 16:07:06.077481 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writer thread running {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:07:06.082894 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_db.sqlalchemy.engines [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117764) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:07:06.092611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writer thread running {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:07:06.397292 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: WARNING keystonemiddleware.auth_token [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:07:06.404700 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: WARNING keystonemiddleware.auth_token [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:07:06.413110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: WARNING keystonemiddleware.auth_token [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:07:06.420815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: WARNING keystonemiddleware.auth_token [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:07:06.747318 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: WARNING keystonemiddleware.auth_token [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:07:06.753954 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: WARNING keystonemiddleware.auth_token [None req-712965ad-d904-442a-b6b8-2e7cf3a9b1d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:07:06.759287 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ecc3f9f9c0 pid: 117763 (default app) May 25 16:07:06.763769 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: WARNING keystonemiddleware.auth_token [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:07:06.769787 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: WARNING keystonemiddleware.auth_token [None req-069b9d68-bf6f-401a-8a4d-66ae55161b28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:07:06.775061 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ecc3f9f9c0 pid: 117764 (default app) May 25 16:07:47.961956 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:47.964338 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:47.966745 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:47.967562 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:48.131258 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=3 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:48.135220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=3 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:48.137275 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=3 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:48.138116 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=3 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:49.379402 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f7c0a02f-b03d-4f90-bfd5-d5e501fcc0bf tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Action: 'create', calling method: .version_select at 0x7fbaf1fbcca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-888974115", "metadata": {"Type": "work"}}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:07:49.562450 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d7f188c7-86ce-4bc2-add5-d35baa607ce5 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Action: 'create', calling method: .version_select at 0x7fbaf1fbbca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-379984454"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:07:51.204017 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d7f188c7-86ce-4bc2-add5-d35baa607ce5 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.261227 May 25 16:07:51.205220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 1/1] 10.222.0.85 () {60 vars in 1154 bytes} [Wed May 25 16:07:47 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3264 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 16:07:51.218584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-39b4cf64-23cc-4fcd-b9b7-20479f3805df tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1e0dc10>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:51.351279 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-39b4cf64-23cc-4fcd-b9b7-20479f3805df tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369" status: 200 len: 344 microversion: 2.1 time: 0.137531 May 25 16:07:51.357629 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 2/2] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:51 2022] GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:51.383637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f7c0a02f-b03d-4f90-bfd5-d5e501fcc0bf tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.263064 May 25 16:07:51.392649 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1155 bytes} [Wed May 25 16:07:48 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3270 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 16:07:51.398005 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d5a05a89-31f4-42c7-8dc8-98f74027ffd0 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Calling method '.version_select at 0x7fbaf1e0ddc0>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:51.500331 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d5a05a89-31f4-42c7-8dc8-98f74027ffd0 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5" status: 200 len: 352 microversion: 2.1 time: 0.106168 May 25 16:07:51.501326 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 3/4] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:51 2022] GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:52.364923 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6aae9404-98f3-44d6-aed4-0a6f31e10af0 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1e0fc10>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:52.425619 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6aae9404-98f3-44d6-aed4-0a6f31e10af0 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369" status: 200 len: 345 microversion: 2.1 time: 0.065013 May 25 16:07:52.426457 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 2/5] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:52 2022] GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:52.437751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b79c796f-034d-4dd4-a636-7a576f74d56c tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Action: 'create', calling method: .version_select at 0x7fbaf1e213a0>, body: {"snapshot": {"volume_id": "602f8c61-ed30-4b9b-b3ad-d12aec352369", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1182986976"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:07:52.547279 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1059251848", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "networks": [{"uuid": "e9b37dbb-a6ec-4de2-ba40-2fff8744b63a"}]}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:07:52.741032 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.network.neutron [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] validate_networks() for [('e9b37dbb-a6ec-4de2-ba40-2fff8744b63a', None, None, None, None, None)] {{(pid=117764) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:07:52.804763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b79c796f-034d-4dd4-a636-7a576f74d56c tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.370689 May 25 16:07:52.805833 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 4/6] 10.222.0.85 () {60 vars in 1161 bytes} [Wed May 25 16:07:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:52.810573 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0aa38fc8-ee5e-4015-889e-68769c2308d7 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Calling method '.version_select at 0x7fbaf1e2a040>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:52.900904 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0aa38fc8-ee5e-4015-889e-68769c2308d7 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5" status: 200 len: 353 microversion: 2.1 time: 0.093736 May 25 16:07:52.901473 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 5/7] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:52 2022] GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:52.906156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3ff74755-61c2-46f4-a643-ed9b139a138c tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1e21c10>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:53.086473 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3ff74755-61c2-46f4-a643-ed9b139a138c tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6" status: 200 len: 287 microversion: 2.1 time: 0.183934 May 25 16:07:53.087442 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 6/8] 10.222.0.85 () {58 vars in 1250 bytes} [Wed May 25 16:07:52 2022] GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 => generated 287 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:53.092578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8bb37609-d8a2-4e3d-84cb-aad7bb211a67 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Calling method '.version_select at 0x7fbaf1e21670>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:53.222959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8bb37609-d8a2-4e3d-84cb-aad7bb211a67 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5" status: 200 len: 353 microversion: 2.1 time: 0.117131 May 25 16:07:53.222959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 7/9] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:53 2022] GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:53.222959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3dfba764-c8b6-45c7-b9b0-8f81b7d911ca tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1e0db80>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:53.332314 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3dfba764-c8b6-45c7-b9b0-8f81b7d911ca tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.124227 May 25 16:07:53.333243 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 8/10] 10.222.0.85 () {58 vars in 1139 bytes} [Wed May 25 16:07:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:53.338587 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-505538f2-2e00-430b-afc1-9b03ea2fb3d5 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Calling method '.version_select at 0x7fbaf1e0de50>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:53.548546 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-505538f2-2e00-430b-afc1-9b03ea2fb3d5 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5" status: 202 len: 0 microversion: 2.1 time: 0.214218 May 25 16:07:53.549529 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 9/11] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:07:53 2022] DELETE /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:07:53.554368 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3eeb7769-bfe3-49d4-8066-f0750e7f8c75 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1e21550>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:53.640887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3eeb7769-bfe3-49d4-8066-f0750e7f8c75 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6" status: 200 len: 287 microversion: 2.1 time: 0.090176 May 25 16:07:53.641445 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 10/12] 10.222.0.85 () {58 vars in 1250 bytes} [Wed May 25 16:07:53 2022] GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:53.646378 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6ec3a393-0c75-4b8a-ad3b-4f55a7c00899 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Calling method '.version_select at 0x7fbaf1e21b80>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:53.756258 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6ec3a393-0c75-4b8a-ad3b-4f55a7c00899 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5" status: 200 len: 352 microversion: 2.1 time: 0.113514 May 25 16:07:53.757158 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 11/13] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:53 2022] GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:54.657408 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6901b254-d5e8-4dcd-8d09-9090546b3cd6 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1e2a160>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:54.721079 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6901b254-d5e8-4dcd-8d09-9090546b3cd6 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6" status: 200 len: 287 microversion: 2.1 time: 0.068164 May 25 16:07:54.722624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 12/14] 10.222.0.85 () {58 vars in 1250 bytes} [Wed May 25 16:07:54 2022] GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:07:54.775038 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-dd0abf0c-1b84-43c4-b0e2-f68d71c7e6bf tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Calling method '.version_select at 0x7fbaf1e21b80>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:54.879779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-dd0abf0c-1b84-43c4-b0e2-f68d71c7e6bf tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5" status: 200 len: 352 microversion: 2.1 time: 0.114134 May 25 16:07:54.880821 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 13/15] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:54 2022] GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:07:55.393657 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Flavor limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:07:55.394168 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Image limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:07:55.394737 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Flavor pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:07:55.395262 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Image pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:07:55.395774 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:07:55.423578 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:07:55.427945 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:07:55.429261 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:07:55.432476 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:07:55.512636 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Getting quotas for project 1f6d103cb389478f94ce6afe687c0e28. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:07:55.529550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Getting quotas for user 1d4d043b13da4b17830481f4a8da9b79 and project 1f6d103cb389478f94ce6afe687c0e28. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:07:55.560093 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Going to run 1 instances... {{(pid=117764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:07:55.563261 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:07:55.706254 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f11ec575-8124-473d-b541-2ac0aa9f8c3d tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.256648 May 25 16:07:55.713358 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 3/16] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:07:55.719472 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1c388f76-5311-4794-a939-2d8f30edb221 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:55.724399 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1c388f76-5311-4794-a939-2d8f30edb221 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:07:55.735227 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4fd52f4a-f4e3-4552-8744-f4f27d70384f tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1526790>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:55.788805 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4fd52f4a-f4e3-4552-8744-f4f27d70384f tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6" status: 200 len: 287 microversion: 2.1 time: 0.058347 May 25 16:07:55.793175 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 4/17] 10.222.0.85 () {58 vars in 1250 bytes} [Wed May 25 16:07:55 2022] GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:07:55.893262 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f5f81a60-7fb5-4d61-89d2-67326dc4aa00 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Calling method '.version_select at 0x7fbaf1526940>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:55.999557 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1c388f76-5311-4794-a939-2d8f30edb221 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:07:56.010419 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f5f81a60-7fb5-4d61-89d2-67326dc4aa00 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5" status: 200 len: 352 microversion: 2.1 time: 0.121861 May 25 16:07:56.011124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 5/18] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:55 2022] GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:07:56.050935 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1c388f76-5311-4794-a939-2d8f30edb221 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1215 microversion: 2.1 time: 0.337007 May 25 16:07:56.055983 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 14/19] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:07:55 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:07:56.801471 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9e6b3daf-9d75-40a0-bd68-65e339ed813d tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1526ca0>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:56.857402 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9e6b3daf-9d75-40a0-bd68-65e339ed813d tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6" status: 200 len: 288 microversion: 2.1 time: 0.059958 May 25 16:07:56.858145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 6/20] 10.222.0.85 () {58 vars in 1250 bytes} [Wed May 25 16:07:56 2022] GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 => generated 288 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:56.872860 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6863b474-4f66-4612-b954-6ad345a04c89 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1e0dc10>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:57.016812 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6863b474-4f66-4612-b954-6ad345a04c89 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "DELETE /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6" status: 202 len: 0 microversion: 2.1 time: 0.150546 May 25 16:07:57.017643 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 15/21] 10.222.0.85 () {58 vars in 1253 bytes} [Wed May 25 16:07:56 2022] DELETE /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:07:57.025791 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2352a064-39b9-4835-8e5c-4d535cd16cc1 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Calling method '.version_select at 0x7fbaf153f3a0>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:57.032843 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-302b2064-f05f-4038-853d-f44769ba924a tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1dec940>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:57.114005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-2352a064-39b9-4835-8e5c-4d535cd16cc1 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] HTTP exception thrown: Volume 1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 could not be found. May 25 16:07:57.117285 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-302b2064-f05f-4038-853d-f44769ba924a tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6" status: 200 len: 287 microversion: 2.1 time: 0.094440 May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2352a064-39b9-4835-8e5c-4d535cd16cc1 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Request method failure captured: May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 HTTP/1.1 May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRT4oPd_L9WmdbNp_7hdn_-dfJkpTSLiNyD7koxhTCJkopXiEOqXAKMF5MG5p_UOD59PcAxPmRazju3PoihCdy_-vkSdWz23g4-QpVOnZnza8qEI2L_KWrDIF44KIt3Z3Vz8O4cbueq8wjm2YFe17cq_LGuLD9bM8jAHExvsnDYFxk May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 0b10cd68403a4ef7888e6ed340a04916 May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesGetTestJSON-1125447760 May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:07:57.119003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0b10cd68403a4ef7888e6ed340a04916", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0b10cd68403a4ef7888e6ed340a04916"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0b10cd68403a4ef7888e6ed340a04916"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0b10cd68403a4ef7888e6ed340a04916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesGetTestJSON-1125447760 May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 0b10cd68403a4ef7888e6ed340a04916 May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesGetTestJSON-1125447760 May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesGetTestJSON-1125447760-project May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 09ea4058ec5f4cbea82069ee235ef911 May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesGetTestJSON-1125447760-project May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Volume 1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 could not be found. May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5'} May 25 16:07:57.120181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 could not be found. (HTTP 404) (Request-ID: req-2cdb8516-5d69-4bee-b93e-e235a02e22d7) May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:07:57.120827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:07:57.121967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 could not be found. May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 16:07:57.123215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 could not be found. May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 could not be found. May 25 16:07:57.125112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:57.126064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 16/22] 10.222.0.85 () {58 vars in 1250 bytes} [Wed May 25 16:07:57 2022] GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:57.126173 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2352a064-39b9-4835-8e5c-4d535cd16cc1 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] Returning 404 to user: Volume 1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:07:57.126173 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2352a064-39b9-4835-8e5c-4d535cd16cc1 tempest-VolumesGetTestJSON-1125447760 tempest-VolumesGetTestJSON-1125447760-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5" status: 404 len: 109 microversion: 2.1 time: 0.106324 May 25 16:07:57.127436 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-de4c4ccf-f446-42c5-b8f7-b0f40f2f92d7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:57.128097 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-de4c4ccf-f446-42c5-b8f7-b0f40f2f92d7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:07:57.128508 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 7/23] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:57 2022] GET /compute/v2.1/os-volumes/1b54f2ae-2f5d-44fc-b8f1-ff80a79bf7d5 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:07:57.648952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-de4c4ccf-f446-42c5-b8f7-b0f40f2f92d7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:07:57.672415 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-de4c4ccf-f446-42c5-b8f7-b0f40f2f92d7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1215 microversion: 2.1 time: 0.549592 May 25 16:07:57.691515 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 17/24] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:07:57 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1215 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:07:58.130038 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-acd99e83-e214-42f1-8f8d-80af52404b57 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf153fd30>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:58.180754 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-acd99e83-e214-42f1-8f8d-80af52404b57 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] HTTP exception thrown: Snapshot bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 could not be found. May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-acd99e83-e214-42f1-8f8d-80af52404b57 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Request method failure captured: May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 HTTP/1.1 May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRTEVRV6931NLx14CawWYZoyK58fBOvQi_RleoQGMLqfw8LetxWznPd7aDxAWc-xLQvLerI-R9aZZvur6BLb0rUcdFVg5p6_opRFIo9WIWIpPej53ZXyoEBBEw7QNyDi7jgk3s24c2bv_e0wC5LwAd6KciFpug6d5d5zWnHdOC_WHE May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 04d735ad2d88494f95cda019507da1df May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:07:58.184103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_04d735ad2d88494f95cda019507da1df", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/04d735ad2d88494f95cda019507da1df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/04d735ad2d88494f95cda019507da1df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/04d735ad2d88494f95cda019507da1df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 04d735ad2d88494f95cda019507da1df May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesSnapshotsTestJSON-1127579083-project May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: e970b42de0dd4ecbb11bfa8401d234e5 May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1127579083-project May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Snapshot bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 could not be found. May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'bf5abe80-af80-4993-8e8c-f5db6c1cc8f6'} May 25 16:07:58.185160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 could not be found. (HTTP 404) (Request-ID: req-c6311e68-b992-4be4-a9aa-12dcc1107493) May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:58.185827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:07:58.186644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 could not be found. May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 25 16:07:58.187611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 could not be found. May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 could not be found. May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-acd99e83-e214-42f1-8f8d-80af52404b57 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Returning 404 to user: Snapshot bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:07:58.192841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-acd99e83-e214-42f1-8f8d-80af52404b57 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6" status: 404 len: 111 microversion: 2.1 time: 0.060873 May 25 16:07:58.193644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 8/25] 10.222.0.85 () {58 vars in 1250 bytes} [Wed May 25 16:07:58 2022] GET /compute/v2.1/os-snapshots/bf5abe80-af80-4993-8e8c-f5db6c1cc8f6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:07:58.195703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-761eac19-73bb-45fa-99ed-177b92589965 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1e0df70>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:58.314356 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-761eac19-73bb-45fa-99ed-177b92589965 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369" status: 202 len: 0 microversion: 2.1 time: 0.122651 May 25 16:07:58.319099 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 18/26] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:07:58 2022] DELETE /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:07:58.348832 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a4a5624c-32fe-48cc-90c2-dc1d8b867956 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1526ee0>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:58.432869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a4a5624c-32fe-48cc-90c2-dc1d8b867956 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369" status: 200 len: 344 microversion: 2.1 time: 0.103329 May 25 16:07:58.433722 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 9/27] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:58 2022] GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 => generated 344 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:58.697143 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2a9b313d-3098-41c8-b906-a810097f58c8 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:58.697759 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2a9b313d-3098-41c8-b906-a810097f58c8 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:07:58.710109 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2a9b313d-3098-41c8-b906-a810097f58c8 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:07:58.710562 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2a9b313d-3098-41c8-b906-a810097f58c8 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:07:58.711343 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2a9b313d-3098-41c8-b906-a810097f58c8 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:07:58.711772 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2a9b313d-3098-41c8-b906-a810097f58c8 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:07:59.135910 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2a9b313d-3098-41c8-b906-a810097f58c8 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:07:59.164352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2a9b313d-3098-41c8-b906-a810097f58c8 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1219 microversion: 2.1 time: 0.474635 May 25 16:07:59.180217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 19/28] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:07:58 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1219 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:07:59.446407 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3fe5b4d3-298e-488c-b7db-3ada407ee34d tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf0ca6700>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:07:59.542879 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3fe5b4d3-298e-488c-b7db-3ada407ee34d tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369" status: 200 len: 344 microversion: 2.1 time: 0.100742 May 25 16:07:59.543627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 10/29] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:07:59 2022] GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:07:59.994341 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1898188794", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:00.213916 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] validate_networks() for [('877c8ddf-7ab7-4a0d-986b-a567e6cc159c', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:08:00.245334 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-19544168-576f-4153-a7ae-b1dd942a7dca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'create', calling method: .version_select at 0x7fbaf0ca6b80>, body: {"keypair": {"name": "tempest-keypair-2002790312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5AGC7RbCUGeqyqlvQ8jLXPxXeWxR1uypA4XYyc7CqS6aLGTS+PCYL5O11F9N9cMecXUjbDMWcYW7200PPt51YWdqATb/doaGgoq+8jcS/rLPHd+yeniDZpAfKP1DsNFA=="}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:00.303022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-19544168-576f-4153-a7ae-b1dd942a7dca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Getting quotas for project feb4d81e1722439591065849449aeb18. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:08:00.318338 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-19544168-576f-4153-a7ae-b1dd942a7dca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Getting quotas for user be5c51fdd2fe4159a83a560dc074da6b and project feb4d81e1722439591065849449aeb18. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:08:00.406654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-19544168-576f-4153-a7ae-b1dd942a7dca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.348733 May 25 16:08:00.407960 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 11/30] 10.222.0.85 () {62 vars in 1199 bytes} [Wed May 25 16:08:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 351 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 16:08:00.444090 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2189c0b9-1bd2-414c-bde1-cb23f60ce96f tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:00.446777 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2189c0b9-1bd2-414c-bde1-cb23f60ce96f tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:00.488625 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2189c0b9-1bd2-414c-bde1-cb23f60ce96f tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:00.495732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2189c0b9-1bd2-414c-bde1-cb23f60ce96f tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:00.496732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2189c0b9-1bd2-414c-bde1-cb23f60ce96f tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:00.497182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2189c0b9-1bd2-414c-bde1-cb23f60ce96f tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:01.276394 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2189c0b9-1bd2-414c-bde1-cb23f60ce96f tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:01.346725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2189c0b9-1bd2-414c-bde1-cb23f60ce96f tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1219 microversion: 2.1 time: 0.937375 May 25 16:08:01.362128 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 12/31] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:00 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1219 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:01.405189 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0641efa5-52c1-4fbf-bc29-a751dc7bf622 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf1e3b700>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:01.627922 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-0641efa5-52c1-4fbf-bc29-a751dc7bf622 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] HTTP exception thrown: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0641efa5-52c1-4fbf-bc29-a751dc7bf622 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Request method failure captured: May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 HTTP/1.1 May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRTEVRV6931NLx14CawWYZoyK58fBOvQi_RleoQGMLqfw8LetxWznPd7aDxAWc-xLQvLerI-R9aZZvur6BLb0rUcdFVg5p6_opRFIo9WIWIpPej53ZXyoEBBEw7QNyDi7jgk3s24c2bv_e0wC5LwAd6KciFpug6d5d5zWnHdOC_WHE May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 04d735ad2d88494f95cda019507da1df May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:08:01.634440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_04d735ad2d88494f95cda019507da1df", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/04d735ad2d88494f95cda019507da1df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/04d735ad2d88494f95cda019507da1df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/04d735ad2d88494f95cda019507da1df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 04d735ad2d88494f95cda019507da1df May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesSnapshotsTestJSON-1127579083-project May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: e970b42de0dd4ecbb11bfa8401d234e5 May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1127579083-project May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '602f8c61-ed30-4b9b-b3ad-d12aec352369'} May 25 16:08:01.635433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. (HTTP 404) (Request-ID: req-f40467dd-ca60-4b5e-9f47-558ed61c5330) May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:01.636219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:08:01.637130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 16:08:01.637990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.638844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.639542 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0641efa5-52c1-4fbf-bc29-a751dc7bf622 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Returning 404 to user: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:08:01.640732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0641efa5-52c1-4fbf-bc29-a751dc7bf622 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369" status: 404 len: 109 microversion: 2.1 time: 0.269777 May 25 16:08:01.650543 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 13/32] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:08:01 2022] GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 => generated 109 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:08:01.661557 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0d621a9f-579e-43d6-8595-c7f1953c6c85 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf03d4820>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:01.750520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-0d621a9f-579e-43d6-8595-c7f1953c6c85 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] HTTP exception thrown: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0d621a9f-579e-43d6-8595-c7f1953c6c85 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Request method failure captured: May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: DELETE /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 HTTP/1.1 May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRTEVRV6931NLx14CawWYZoyK58fBOvQi_RleoQGMLqfw8LetxWznPd7aDxAWc-xLQvLerI-R9aZZvur6BLb0rUcdFVg5p6_opRFIo9WIWIpPej53ZXyoEBBEw7QNyDi7jgk3s24c2bv_e0wC5LwAd6KciFpug6d5d5zWnHdOC_WHE May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 04d735ad2d88494f95cda019507da1df May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:08:01.754424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_04d735ad2d88494f95cda019507da1df", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/04d735ad2d88494f95cda019507da1df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/04d735ad2d88494f95cda019507da1df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/04d735ad2d88494f95cda019507da1df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 04d735ad2d88494f95cda019507da1df May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesSnapshotsTestJSON-1127579083-project May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: e970b42de0dd4ecbb11bfa8401d234e5 May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1127579083-project May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '602f8c61-ed30-4b9b-b3ad-d12aec352369'} May 25 16:08:01.755473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. (HTTP 404) (Request-ID: req-ce938381-d94a-4bb2-8b20-a3ec8cd1f695) May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:01.756169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:08:01.757043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 16:08:01.758845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.759961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.778449 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0d621a9f-579e-43d6-8595-c7f1953c6c85 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Returning 404 to user: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:08:01.781296 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0d621a9f-579e-43d6-8595-c7f1953c6c85 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369" status: 404 len: 109 microversion: 2.1 time: 0.129254 May 25 16:08:01.785317 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 14/33] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:08:01 2022] DELETE /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:08:01.803912 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6aac4e34-b54b-4058-9782-dbe08fa91bb0 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Calling method '.version_select at 0x7fbaf0438f70>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:01.863235 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-6aac4e34-b54b-4058-9782-dbe08fa91bb0 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] HTTP exception thrown: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6aac4e34-b54b-4058-9782-dbe08fa91bb0 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Request method failure captured: May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 HTTP/1.1 May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRTEVRV6931NLx14CawWYZoyK58fBOvQi_RleoQGMLqfw8LetxWznPd7aDxAWc-xLQvLerI-R9aZZvur6BLb0rUcdFVg5p6_opRFIo9WIWIpPej53ZXyoEBBEw7QNyDi7jgk3s24c2bv_e0wC5LwAd6KciFpug6d5d5zWnHdOC_WHE May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 04d735ad2d88494f95cda019507da1df May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:08:01.865903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_04d735ad2d88494f95cda019507da1df", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/04d735ad2d88494f95cda019507da1df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/04d735ad2d88494f95cda019507da1df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/04d735ad2d88494f95cda019507da1df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 04d735ad2d88494f95cda019507da1df May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1127579083 May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesSnapshotsTestJSON-1127579083-project May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: e970b42de0dd4ecbb11bfa8401d234e5 May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1127579083-project May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '602f8c61-ed30-4b9b-b3ad-d12aec352369'} May 25 16:08:01.867552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. (HTTP 404) (Request-ID: req-5354b1bb-5058-4c80-a25b-742575270b09) May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:01.868428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:08:01.870211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 16:08:01.871333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. May 25 16:08:01.873864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:01.875130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6aac4e34-b54b-4058-9782-dbe08fa91bb0 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] Returning 404 to user: Volume 602f8c61-ed30-4b9b-b3ad-d12aec352369 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:08:01.876904 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6aac4e34-b54b-4058-9782-dbe08fa91bb0 tempest-VolumesSnapshotsTestJSON-1127579083 tempest-VolumesSnapshotsTestJSON-1127579083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369" status: 404 len: 109 microversion: 2.1 time: 0.079007 May 25 16:08:01.877951 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 15/34] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:08:01 2022] GET /compute/v2.1/os-volumes/602f8c61-ed30-4b9b-b3ad-d12aec352369 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:08:02.384040 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-604fa927-6d30-4a47-9fc0-99d5c5902f5e tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:02.384961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-604fa927-6d30-4a47-9fc0-99d5c5902f5e tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:02.400647 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-604fa927-6d30-4a47-9fc0-99d5c5902f5e tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:02.409860 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-604fa927-6d30-4a47-9fc0-99d5c5902f5e tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:02.413697 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-604fa927-6d30-4a47-9fc0-99d5c5902f5e tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:02.414152 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-604fa927-6d30-4a47-9fc0-99d5c5902f5e tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:02.791564 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-604fa927-6d30-4a47-9fc0-99d5c5902f5e tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:02.802465 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-604fa927-6d30-4a47-9fc0-99d5c5902f5e tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1275 microversion: 2.1 time: 0.425386 May 25 16:08:02.808450 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 16/35] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:02 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1275 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:03.829873 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0e5728a3-ece9-44e8-9894-5eb7e6aaa0cf tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:03.831184 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0e5728a3-ece9-44e8-9894-5eb7e6aaa0cf tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:03.838150 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e5728a3-ece9-44e8-9894-5eb7e6aaa0cf tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:03.838843 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e5728a3-ece9-44e8-9894-5eb7e6aaa0cf tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:03.840113 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e5728a3-ece9-44e8-9894-5eb7e6aaa0cf tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:03.840735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e5728a3-ece9-44e8-9894-5eb7e6aaa0cf tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:04.322873 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:08:04.323410 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:08:04.323776 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:08:04.324300 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:08:04.324716 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:08:04.361926 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:04.362398 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:04.365435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:04.367459 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:04.461382 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Getting quotas for project f7733d8b5059433eb18dc6b174eb9533. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:08:04.485963 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Getting quotas for user d0427d9cce40423185a40df61c3617a6 and project f7733d8b5059433eb18dc6b174eb9533. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:08:04.489742 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0e5728a3-ece9-44e8-9894-5eb7e6aaa0cf tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:04.511417 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0e5728a3-ece9-44e8-9894-5eb7e6aaa0cf tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1273 microversion: 2.1 time: 0.681089 May 25 16:08:04.523898 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 17/36] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:03 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1273 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:04.524345 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:08:04.524345 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:08:04.857921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-13715a86-752c-4103-884e-7743415314a7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.137313 May 25 16:08:04.868465 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 20/37] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:07:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 5149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:08:04.870949 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f9ecc08e-06b2-4398-b04c-54f5bd1d5b34 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:04.871881 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f9ecc08e-06b2-4398-b04c-54f5bd1d5b34 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:05.122352 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f9ecc08e-06b2-4398-b04c-54f5bd1d5b34 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:05.149426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f9ecc08e-06b2-4398-b04c-54f5bd1d5b34 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1222 microversion: 2.1 time: 0.282552 May 25 16:08:05.179213 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 18/38] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:04 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1222 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:05.536662 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-15491c71-05de-4141-bf1d-dbd68863f987 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:05.537289 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-15491c71-05de-4141-bf1d-dbd68863f987 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:05.602551 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15491c71-05de-4141-bf1d-dbd68863f987 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:05.605979 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15491c71-05de-4141-bf1d-dbd68863f987 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:05.608553 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15491c71-05de-4141-bf1d-dbd68863f987 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:05.609192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15491c71-05de-4141-bf1d-dbd68863f987 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:05.624532 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1458517440", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:05.673520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:05.873758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.network.neutron [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] validate_networks() for [('877c8ddf-7ab7-4a0d-986b-a567e6cc159c', None, None, None, None, None)] {{(pid=117764) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:08:06.089454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-15491c71-05de-4141-bf1d-dbd68863f987 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:06.101363 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-15491c71-05de-4141-bf1d-dbd68863f987 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1273 microversion: 2.1 time: 0.572139 May 25 16:08:06.114187 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 21/39] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:05 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1273 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:07.122252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ce34f229-690a-4395-ae3f-7f63b65be3dc tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:07.123148 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ce34f229-690a-4395-ae3f-7f63b65be3dc tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:07.135150 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce34f229-690a-4395-ae3f-7f63b65be3dc tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:07.137393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce34f229-690a-4395-ae3f-7f63b65be3dc tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:07.138539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce34f229-690a-4395-ae3f-7f63b65be3dc tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:07.140424 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce34f229-690a-4395-ae3f-7f63b65be3dc tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:07.500730 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce34f229-690a-4395-ae3f-7f63b65be3dc tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:07.522243 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ce34f229-690a-4395-ae3f-7f63b65be3dc tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1273 microversion: 2.1 time: 0.403640 May 25 16:08:07.536892 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 22/40] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:07 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1273 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:07.725804 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-bb65e8a0-7293-4890-a711-4f61d4ab42fa tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: .version_select at 0x7fbaf142da60>, body: {"keypair": {"name": "tempest-keypair-964042399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYXI8TIi7eMb+q1rS7TokKIONK4xVzuIkY45iCBjeFJDKQX5fpAaORiL54TWZk0m1f5fMxvRmMHPlrIQRJZ2chNKH1tXqSld0mVUXF8C+KF0Q2JXDZhoQyx/ncYeA3J5A=="}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:07.763259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-bb65e8a0-7293-4890-a711-4f61d4ab42fa tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for project 32e48e8e884b4840ba54d546d82d2334. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:08:07.773279 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-bb65e8a0-7293-4890-a711-4f61d4ab42fa tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for user 708fdc537e1747d7bd5917ed7af9c368 and project 32e48e8e884b4840ba54d546d82d2334. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:08:07.844735 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-bb65e8a0-7293-4890-a711-4f61d4ab42fa tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.306242 May 25 16:08:07.845565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 23/41] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:08:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:07.883757 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Flavor limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:08:07.884292 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Image limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:08:07.884719 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Flavor pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:08:07.885155 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Image pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:08:07.885568 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:08:07.907402 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:07.911038 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:07.912162 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:07.915070 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:07.967987 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Getting quotas for project f7733d8b5059433eb18dc6b174eb9533. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:08:07.974620 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Getting quotas for user d0427d9cce40423185a40df61c3617a6 and project f7733d8b5059433eb18dc6b174eb9533. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:08:08.005849 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Going to run 1 instances... {{(pid=117764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:08:08.009886 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:08:08.122493 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cf0a43f7-032d-4e1f-a428-79a2c574846f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.503028 May 25 16:08:08.123784 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 19/42] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:08:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:08:08.135422 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e0547bfa-5008-4660-9b65-f66e08b18780 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:08.139433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e0547bfa-5008-4660-9b65-f66e08b18780 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:08.551529 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-07c3a7bf-805d-4cfb-a772-c8a024a56090 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:08.553319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-07c3a7bf-805d-4cfb-a772-c8a024a56090 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:08.577263 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-07c3a7bf-805d-4cfb-a772-c8a024a56090 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:08.581260 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-07c3a7bf-805d-4cfb-a772-c8a024a56090 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:08.584922 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-07c3a7bf-805d-4cfb-a772-c8a024a56090 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:08.589165 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-07c3a7bf-805d-4cfb-a772-c8a024a56090 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:08.796510 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-07c3a7bf-805d-4cfb-a772-c8a024a56090 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:08.805854 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-07c3a7bf-805d-4cfb-a772-c8a024a56090 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1273 microversion: 2.1 time: 0.267040 May 25 16:08:08.810119 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 20/43] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:08 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:08.820010 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1309593704", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a65193d0-d741-4333-90e3-e22c40adb85c"}], "security_groups": [{"name": "tempest-securitygroup--320864526"}], "key_name": "tempest-keypair-2002790312", "user_data": "}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:08.825532 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e0547bfa-5008-4660-9b65-f66e08b18780 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:08.834357 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e0547bfa-5008-4660-9b65-f66e08b18780 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1222 microversion: 2.1 time: 0.704150 May 25 16:08:08.849381 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 24/44] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:08 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1222 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:09.220298 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3c204426-eb47-4bc7-a457-f8cea96815af tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'create', calling method: .version_select at 0x7fbaf1422d30>, body: {"keypair": {"name": "tempest-keypair-2010957746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ4ioNfMRaLviEp1zBovgQzAtScx2nujHpr7+7FtY3J+zjltfkbslaD1+Pw7y+Disfa4b7+2MfTIfgYOlLdn93gC9ADtduvMYri3vyFIW48qdrQ7p0IbeUud+2do0lVZg=="}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:09.263408 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-3c204426-eb47-4bc7-a457-f8cea96815af tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Getting quotas for project 93946fd1575e45428d2388015d64628f. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:08:09.279595 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-3c204426-eb47-4bc7-a457-f8cea96815af tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Getting quotas for user a0289402c6f245839a86b7b66714a8f6 and project 93946fd1575e45428d2388015d64628f. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:08:09.326886 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.network.neutron [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] validate_networks() for [('a65193d0-d741-4333-90e3-e22c40adb85c', None, None, None, None, None)] {{(pid=117764) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:08:09.369857 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3c204426-eb47-4bc7-a457-f8cea96815af tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.311362 May 25 16:08:09.372209 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 25/45] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:08:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:08:09.826584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7d294556-0d80-4685-ba4e-5844c6b72719 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:09.827566 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7d294556-0d80-4685-ba4e-5844c6b72719 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:09.844897 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d294556-0d80-4685-ba4e-5844c6b72719 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:09.849249 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d294556-0d80-4685-ba4e-5844c6b72719 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:09.852507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d294556-0d80-4685-ba4e-5844c6b72719 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:09.854985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d294556-0d80-4685-ba4e-5844c6b72719 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:10.913585 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7d294556-0d80-4685-ba4e-5844c6b72719 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:10.930555 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7d294556-0d80-4685-ba4e-5844c6b72719 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 1.106153 May 25 16:08:10.933455 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 26/46] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:09 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:10.969297 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7536bcd1-5fb6-4fa4-a0ee-bc8aab63ab20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:10.971675 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7536bcd1-5fb6-4fa4-a0ee-bc8aab63ab20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:10.982721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7536bcd1-5fb6-4fa4-a0ee-bc8aab63ab20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:10.983617 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7536bcd1-5fb6-4fa4-a0ee-bc8aab63ab20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:10.985616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7536bcd1-5fb6-4fa4-a0ee-bc8aab63ab20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:10.987893 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7536bcd1-5fb6-4fa4-a0ee-bc8aab63ab20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:11.205993 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7536bcd1-5fb6-4fa4-a0ee-bc8aab63ab20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:11.218912 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7536bcd1-5fb6-4fa4-a0ee-bc8aab63ab20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1280 microversion: 2.1 time: 0.270232 May 25 16:08:11.219704 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 27/47] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:10 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1280 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:11.950119 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-15a18ac0-37f5-4af3-aaa9-976f128a4e53 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:11.950852 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-15a18ac0-37f5-4af3-aaa9-976f128a4e53 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:11.962481 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15a18ac0-37f5-4af3-aaa9-976f128a4e53 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:11.964614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15a18ac0-37f5-4af3-aaa9-976f128a4e53 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:11.965463 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15a18ac0-37f5-4af3-aaa9-976f128a4e53 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:11.965906 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15a18ac0-37f5-4af3-aaa9-976f128a4e53 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:12.537011 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-15a18ac0-37f5-4af3-aaa9-976f128a4e53 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:12.545322 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-15a18ac0-37f5-4af3-aaa9-976f128a4e53 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 0.599786 May 25 16:08:12.563419 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 28/48] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:11 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:12.582824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-62321014-1407-4915-a516-420bfa7eaa20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:12.586224 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-62321014-1407-4915-a516-420bfa7eaa20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:12.606121 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62321014-1407-4915-a516-420bfa7eaa20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:12.606867 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62321014-1407-4915-a516-420bfa7eaa20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:12.610357 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62321014-1407-4915-a516-420bfa7eaa20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:12.621742 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62321014-1407-4915-a516-420bfa7eaa20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:12.883716 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-62321014-1407-4915-a516-420bfa7eaa20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:12.893634 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-62321014-1407-4915-a516-420bfa7eaa20 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1280 microversion: 2.1 time: 0.330380 May 25 16:08:12.899973 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 29/49] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:12 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1280 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:13.570574 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ef37ff07-b7bc-44c8-9267-da8638790e1c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:13.571398 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ef37ff07-b7bc-44c8-9267-da8638790e1c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:13.601842 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ef37ff07-b7bc-44c8-9267-da8638790e1c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:13.602476 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ef37ff07-b7bc-44c8-9267-da8638790e1c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:13.603426 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ef37ff07-b7bc-44c8-9267-da8638790e1c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:13.605498 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ef37ff07-b7bc-44c8-9267-da8638790e1c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:14.415672 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:14.934139 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Flavor limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:08:14.938379 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Image limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:08:14.939108 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Flavor pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:08:14.940197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Image pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:08:14.940761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:08:14.965097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:14.965740 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:14.970542 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:14.971343 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:15.025044 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Getting quotas for project feb4d81e1722439591065849449aeb18. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:08:15.038021 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Getting quotas for user be5c51fdd2fe4159a83a560dc074da6b and project feb4d81e1722439591065849449aeb18. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:08:15.072119 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Going to run 1 instances... {{(pid=117764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:08:15.075028 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:08:15.190589 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cec47261-474a-44e5-a137-0bbe396cea55 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.379139 May 25 16:08:15.191768 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 21/50] 10.222.0.85 () {62 vars in 1187 bytes} [Wed May 25 16:08:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 6381 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 16:08:15.197777 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c7b15bdb-f7a0-459f-a282-960e883559f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:15.198627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c7b15bdb-f7a0-459f-a282-960e883559f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:15.239414 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7b15bdb-f7a0-459f-a282-960e883559f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:15.240146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7b15bdb-f7a0-459f-a282-960e883559f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:15.241436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7b15bdb-f7a0-459f-a282-960e883559f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:15.242238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7b15bdb-f7a0-459f-a282-960e883559f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:15.365234 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ef37ff07-b7bc-44c8-9267-da8638790e1c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:15.378694 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ef37ff07-b7bc-44c8-9267-da8638790e1c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 1.811948 May 25 16:08:15.388392 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 30/51] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:13 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:15.400652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7f91b67e-9e90-4c07-a9ad-ad47ddd49500 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:15.401299 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7f91b67e-9e90-4c07-a9ad-ad47ddd49500 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:15.511043 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7f91b67e-9e90-4c07-a9ad-ad47ddd49500 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:15.536551 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7f91b67e-9e90-4c07-a9ad-ad47ddd49500 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:15.543528 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7f91b67e-9e90-4c07-a9ad-ad47ddd49500 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:15.555037 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7f91b67e-9e90-4c07-a9ad-ad47ddd49500 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1282 microversion: 2.20 time: 0.159000 May 25 16:08:15.557965 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 31/52] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:15 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:16.406497 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5943de82-1006-41d8-a08d-a660270909e7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:16.406497 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5943de82-1006-41d8-a08d-a660270909e7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:16.432634 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5943de82-1006-41d8-a08d-a660270909e7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:16.436834 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5943de82-1006-41d8-a08d-a660270909e7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:16.437805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5943de82-1006-41d8-a08d-a660270909e7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:16.453333 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5943de82-1006-41d8-a08d-a660270909e7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:16.461902 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c7b15bdb-f7a0-459f-a282-960e883559f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:16.472811 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c7b15bdb-f7a0-459f-a282-960e883559f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1322 microversion: 2.1 time: 1.279763 May 25 16:08:16.476353 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 22/53] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:15 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1322 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:16.581012 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:16.585511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:16.619699 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:16.624655 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:16.626980 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:16.630532 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:16.942028 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:16.960628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:16.967961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:16.972665 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-fb9d8b3a-886b-478d-b50f-2215c5cdbab9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1278 microversion: 2.20 time: 0.398910 May 25 16:08:16.975123 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 23/54] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:16 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1278 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:17.479604 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5943de82-1006-41d8-a08d-a660270909e7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:17.492919 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0ad571ea-3b5f-4fb9-99f2-56526d0eee4e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:17.495898 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0ad571ea-3b5f-4fb9-99f2-56526d0eee4e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:17.522578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5943de82-1006-41d8-a08d-a660270909e7 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 1.125339 May 25 16:08:17.538600 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 32/55] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:16 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:17.540906 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ad571ea-3b5f-4fb9-99f2-56526d0eee4e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:17.541527 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ad571ea-3b5f-4fb9-99f2-56526d0eee4e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:17.542499 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ad571ea-3b5f-4fb9-99f2-56526d0eee4e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:17.543063 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ad571ea-3b5f-4fb9-99f2-56526d0eee4e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:17.994254 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:17.996052 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:18.015268 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:18.016526 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:18.020890 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:18.023022 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:18.293325 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:18.302613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:18.304137 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:18.314487 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-159906a3-f24e-4973-9b0b-ce7bb7395c26 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1340 microversion: 2.20 time: 0.325227 May 25 16:08:18.342191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 33/56] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:17 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1340 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:08:19.039710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-b99ab0c3-6715-4acd-8b7e-de9a1b1658d5 req-530395f5-d879-4c87-929b-2db0ace635fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6855067-d8ce-424f-b601-e0df21b52475", "tag": "e7a62f3c-e0c8-466c-b12b-f52f98992106"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:19.063144 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:19.080375 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-b99ab0c3-6715-4acd-8b7e-de9a1b1658d5 req-530395f5-d879-4c87-929b-2db0ace635fe service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:19.080936 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-b99ab0c3-6715-4acd-8b7e-de9a1b1658d5 req-530395f5-d879-4c87-929b-2db0ace635fe service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:19.165658 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-b99ab0c3-6715-4acd-8b7e-de9a1b1658d5 req-530395f5-d879-4c87-929b-2db0ace635fe service nova] Creating event network-changed:e7a62f3c-e0c8-466c-b12b-f52f98992106 for instance b6855067-d8ce-424f-b601-e0df21b52475 on hv-cinder-84327 May 25 16:08:19.168269 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-b99ab0c3-6715-4acd-8b7e-de9a1b1658d5 req-530395f5-d879-4c87-929b-2db0ace635fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=117763) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 16:08:19.170573 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-30208850-bf05-4c82-88c9-f7de6e71a707 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:19.171206 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-30208850-bf05-4c82-88c9-f7de6e71a707 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:19.172529 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-30208850-bf05-4c82-88c9-f7de6e71a707 None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:19.173324 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-30208850-bf05-4c82-88c9-f7de6e71a707 None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:19.224717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.compute.rpcapi [None req-30208850-bf05-4c82-88c9-f7de6e71a707 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 16:08:19.227213 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-30208850-bf05-4c82-88c9-f7de6e71a707 None None] Releasing lock "compute-rpcapi-router" {{(pid=117763) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 16:08:19.321333 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-30208850-bf05-4c82-88c9-f7de6e71a707 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.777695 May 25 16:08:19.323731 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 34/57] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:08:19.337341 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9dc7f157-ad52-4164-965d-a0a450198763 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:19.338747 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9dc7f157-ad52-4164-965d-a0a450198763 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:19.361508 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9dc7f157-ad52-4164-965d-a0a450198763 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:19.362193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9dc7f157-ad52-4164-965d-a0a450198763 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:19.363150 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9dc7f157-ad52-4164-965d-a0a450198763 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:19.363781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9dc7f157-ad52-4164-965d-a0a450198763 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:20.309996 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0ad571ea-3b5f-4fb9-99f2-56526d0eee4e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:20.318304 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=47 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:20.322325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0ad571ea-3b5f-4fb9-99f2-56526d0eee4e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1322 microversion: 2.1 time: 2.833457 May 25 16:08:20.323920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 24/58] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:17 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1322 bytes in 2836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:20.329290 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:20.330366 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:20.335735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=10 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:20.340815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:20.342147 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:20.343574 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:20.344279 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:20.510774 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:20.541057 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:20.553048 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:20.556226 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6d509086-bc9f-433f-ad1d-e1a76d8da528 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1340 microversion: 2.20 time: 0.230877 May 25 16:08:20.557271 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 25/59] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:20 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1340 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:20.989535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9dc7f157-ad52-4164-965d-a0a450198763 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:21.002833 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9dc7f157-ad52-4164-965d-a0a450198763 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 1.675534 May 25 16:08:21.004262 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 35/60] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:19 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:21.076520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-c4ac8f04-e30f-4734-bb5f-fedc5b9841d4 req-f00791a4-e57f-47d0-b216-fde6781cd853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b973684d-dabc-4073-9bd7-cfff6639d737", "tag": "8da9abd8-394d-4fcf-b31f-86f41ec75434"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:21.098152 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-c4ac8f04-e30f-4734-bb5f-fedc5b9841d4 req-f00791a4-e57f-47d0-b216-fde6781cd853 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:21.102432 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-c4ac8f04-e30f-4734-bb5f-fedc5b9841d4 req-f00791a4-e57f-47d0-b216-fde6781cd853 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:21.160939 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-c4ac8f04-e30f-4734-bb5f-fedc5b9841d4 req-f00791a4-e57f-47d0-b216-fde6781cd853 service nova] Creating event network-changed:8da9abd8-394d-4fcf-b31f-86f41ec75434 for instance b973684d-dabc-4073-9bd7-cfff6639d737 on hv-cinder-84327 May 25 16:08:21.162273 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-c4ac8f04-e30f-4734-bb5f-fedc5b9841d4 req-f00791a4-e57f-47d0-b216-fde6781cd853 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 16:08:21.163947 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f0e6ac46-8ad4-4502-92a5-d5de838e3bdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:21.164591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f0e6ac46-8ad4-4502-92a5-d5de838e3bdf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:21.165733 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f0e6ac46-8ad4-4502-92a5-d5de838e3bdf None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:21.167365 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f0e6ac46-8ad4-4502-92a5-d5de838e3bdf None None] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:21.178081 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.compute.rpcapi [None req-f0e6ac46-8ad4-4502-92a5-d5de838e3bdf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 16:08:21.179289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f0e6ac46-8ad4-4502-92a5-d5de838e3bdf None None] Releasing lock "compute-rpcapi-router" {{(pid=117764) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 16:08:21.197543 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f0e6ac46-8ad4-4502-92a5-d5de838e3bdf None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301236 May 25 16:08:21.198449 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 26/61] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:21.341663 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a75b02bc-c145-465f-8080-3f48336796ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:21.342275 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a75b02bc-c145-465f-8080-3f48336796ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:21.359428 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a75b02bc-c145-465f-8080-3f48336796ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:21.359905 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a75b02bc-c145-465f-8080-3f48336796ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:21.360687 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a75b02bc-c145-465f-8080-3f48336796ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:21.361122 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a75b02bc-c145-465f-8080-3f48336796ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:21.584479 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:21.585656 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:21.596191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:21.596955 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:21.598130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:21.598868 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:21.811704 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:21.823611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:21.831867 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:21.838389 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-684dd86c-867c-471c-8fb9-d1b24fefa823 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1340 microversion: 2.20 time: 0.266951 May 25 16:08:21.850829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 27/62] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:21 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1340 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:21.963483 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-78bba5c9-7a94-4220-889b-1a732ffeb27a req-921fbbc7-22d8-4f6b-b5c3-1567b096f654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f650730-0534-4f4b-92b9-6d6be8cc54c7", "tag": "5e831b32-3912-4fc5-8b80-9b3a1edda724"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:21.974770 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-78bba5c9-7a94-4220-889b-1a732ffeb27a req-921fbbc7-22d8-4f6b-b5c3-1567b096f654 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:21.979014 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-78bba5c9-7a94-4220-889b-1a732ffeb27a req-921fbbc7-22d8-4f6b-b5c3-1567b096f654 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:22.019373 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-78bba5c9-7a94-4220-889b-1a732ffeb27a req-921fbbc7-22d8-4f6b-b5c3-1567b096f654 service nova] Creating event network-changed:5e831b32-3912-4fc5-8b80-9b3a1edda724 for instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 on hv-cinder-84327 May 25 16:08:22.049675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-78bba5c9-7a94-4220-889b-1a732ffeb27a req-921fbbc7-22d8-4f6b-b5c3-1567b096f654 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084375 May 25 16:08:22.052849 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 28/63] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:08:22.069076 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8bc178a6-fc2c-48d4-ada4-a2f38fe762ed tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:22.071393 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8bc178a6-fc2c-48d4-ada4-a2f38fe762ed tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:22.091541 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a75b02bc-c145-465f-8080-3f48336796ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:22.094917 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8bc178a6-fc2c-48d4-ada4-a2f38fe762ed tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:22.096914 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8bc178a6-fc2c-48d4-ada4-a2f38fe762ed tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:22.103981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a75b02bc-c145-465f-8080-3f48336796ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1322 microversion: 2.1 time: 0.764140 May 25 16:08:22.105202 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8bc178a6-fc2c-48d4-ada4-a2f38fe762ed tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:22.107892 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 36/64] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:21 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:22.108401 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8bc178a6-fc2c-48d4-ada4-a2f38fe762ed tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:22.240302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-720691013", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2dc3f38-efe8-41d0-ba54-fbd07705ad76"}], "security_groups": [{"name": "tempest-securitygroup--1792762613"}], "key_name": "tempest-keypair-964042399", "user_data": "}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:22.382211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-8bc178a6-fc2c-48d4-ada4-a2f38fe762ed tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:22.396367 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8bc178a6-fc2c-48d4-ada4-a2f38fe762ed tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 0.341828 May 25 16:08:22.396946 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 29/65] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:22 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:22.535881 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] validate_networks() for [('a2dc3f38-efe8-41d0-ba54-fbd07705ad76', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:08:22.856655 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:22.857868 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:22.864272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:22.864965 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:22.866012 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:22.866448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:23.148913 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:23.162184 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:23.166915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:23.168134 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2ba65279-d481-4c6b-8509-019b45349f5f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.315385 May 25 16:08:23.171428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 30/66] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:22 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:08:23.182810 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b02d5536-736f-4cec-97a0-bb1404aec1b3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:23.183365 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b02d5536-736f-4cec-97a0-bb1404aec1b3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:23.194177 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b02d5536-736f-4cec-97a0-bb1404aec1b3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:23.194615 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b02d5536-736f-4cec-97a0-bb1404aec1b3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:23.195587 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b02d5536-736f-4cec-97a0-bb1404aec1b3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:23.196224 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b02d5536-736f-4cec-97a0-bb1404aec1b3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:23.719150 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b02d5536-736f-4cec-97a0-bb1404aec1b3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:23.735574 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b02d5536-736f-4cec-97a0-bb1404aec1b3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1322 microversion: 2.1 time: 0.562975 May 25 16:08:23.743872 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 31/67] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:23 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:23.764566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-62394b4e-3ab2-4477-af90-c8adcaeec196 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:23.765452 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-62394b4e-3ab2-4477-af90-c8adcaeec196 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:23.783502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62394b4e-3ab2-4477-af90-c8adcaeec196 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:23.784042 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62394b4e-3ab2-4477-af90-c8adcaeec196 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:23.784910 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62394b4e-3ab2-4477-af90-c8adcaeec196 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:23.785538 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62394b4e-3ab2-4477-af90-c8adcaeec196 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:23.798066 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:08:23.799154 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:08:23.800102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:08:23.801225 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:08:23.802297 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:08:23.814401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=23 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:23.823136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:23.824271 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:23.827077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:23.828824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:23.862881 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for project 32e48e8e884b4840ba54d546d82d2334. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:08:23.899679 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for user 708fdc537e1747d7bd5917ed7af9c368 and project 32e48e8e884b4840ba54d546d82d2334. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:08:23.937680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:08:23.941789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:08:24.108792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3cbb53d6-12bc-4643-bc59-e2a2b030c2b9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.872772 May 25 16:08:24.115223 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 37/68] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:08:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:08:24.121057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1416636080", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11c18221-40ed-46b2-9546-1ebebf8fc518"}], "security_groups": [{"name": "tempest-securitygroup--268189805"}], "key_name": "tempest-keypair-2010957746", "user_data": "}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:24.385342 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-62394b4e-3ab2-4477-af90-c8adcaeec196 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:24.397696 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-62394b4e-3ab2-4477-af90-c8adcaeec196 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 0.651711 May 25 16:08:24.399762 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 32/69] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:23 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:24.410022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7babffc9-1daa-4794-9681-ebed86871551 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:24.423469 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-7babffc9-1daa-4794-9681-ebed86871551 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:24.685589 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-7babffc9-1daa-4794-9681-ebed86871551 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:24.688077 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=25 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:24.696329 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] validate_networks() for [('11c18221-40ed-46b2-9546-1ebebf8fc518', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:08:24.701418 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-7babffc9-1daa-4794-9681-ebed86871551 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1240 microversion: 2.1 time: 0.299320 May 25 16:08:24.703996 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 33/70] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:24 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1240 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:24.717617 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:24.718448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:24.725306 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:24.725839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:24.726853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:24.727514 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:25.057667 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:25.066028 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:25.068035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:25.069349 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5ab2808e-7abc-45bb-83f6-f27082f955c4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.355783 May 25 16:08:25.070147 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 34/71] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:24 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:25.074786 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f0347fbe-fed9-4ba4-ac6b-c3739f247929 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:25.075559 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f0347fbe-fed9-4ba4-ac6b-c3739f247929 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:25.082319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f0347fbe-fed9-4ba4-ac6b-c3739f247929 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:25.083006 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f0347fbe-fed9-4ba4-ac6b-c3739f247929 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:25.084130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f0347fbe-fed9-4ba4-ac6b-c3739f247929 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:25.084709 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f0347fbe-fed9-4ba4-ac6b-c3739f247929 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:25.570800 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f0347fbe-fed9-4ba4-ac6b-c3739f247929 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:25.582579 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f0347fbe-fed9-4ba4-ac6b-c3739f247929 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1322 microversion: 2.1 time: 0.511225 May 25 16:08:25.585461 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 35/72] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:25 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:25.605876 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5509eea9-f429-4868-8708-c19c01249948 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:25.616004 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5509eea9-f429-4868-8708-c19c01249948 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:25.640449 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5509eea9-f429-4868-8708-c19c01249948 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:25.641711 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5509eea9-f429-4868-8708-c19c01249948 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:25.644624 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5509eea9-f429-4868-8708-c19c01249948 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:25.647794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5509eea9-f429-4868-8708-c19c01249948 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.106580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5509eea9-f429-4868-8708-c19c01249948 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:26.118575 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5509eea9-f429-4868-8708-c19c01249948 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 0.528980 May 25 16:08:26.127302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 36/73] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:25 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:26.140725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5f8d9802-480e-474e-857f-081d8f6014d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:26.141720 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5f8d9802-480e-474e-857f-081d8f6014d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:26.168731 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5f8d9802-480e-474e-857f-081d8f6014d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.169236 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5f8d9802-480e-474e-857f-081d8f6014d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.170630 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5f8d9802-480e-474e-857f-081d8f6014d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.171062 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5f8d9802-480e-474e-857f-081d8f6014d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.276652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:08:26.277715 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:08:26.278379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:08:26.279001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:08:26.280176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:08:26.311878 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.312170 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.315477 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.318185 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.347706 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5f8d9802-480e-474e-857f-081d8f6014d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:26.350239 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Getting quotas for project 93946fd1575e45428d2388015d64628f. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:08:26.354578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Getting quotas for user a0289402c6f245839a86b7b66714a8f6 and project 93946fd1575e45428d2388015d64628f. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:08:26.360632 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5f8d9802-480e-474e-857f-081d8f6014d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1298 microversion: 2.1 time: 0.229922 May 25 16:08:26.362377 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 37/74] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:26 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1298 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:26.367000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:08:26.369415 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:08:26.439755 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2d96aa16-1f6f-4d04-827c-a58d7f03652e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.322824 May 25 16:08:26.442979 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 38/75] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:08:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 2327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:08:26.449587 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:26.450450 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:26.478041 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.481872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.481872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.482136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.776530 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-12b2e332-9cfb-49c3-ae6a-75f665f1cbf3 req-f0b4eb07-0062-4898-ad80-11865582bd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b973684d-dabc-4073-9bd7-cfff6639d737", "name": "network-vif-plugged", "status": "completed", "tag": "8da9abd8-394d-4fcf-b31f-86f41ec75434"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:26.779657 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:26.790507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:26.793737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:26.794911 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-12b2e332-9cfb-49c3-ae6a-75f665f1cbf3 req-f0b4eb07-0062-4898-ad80-11865582bd07 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.795285 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-44ee5a2d-568c-41ae-876d-06654f1e91f7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.350974 May 25 16:08:26.795603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-12b2e332-9cfb-49c3-ae6a-75f665f1cbf3 req-f0b4eb07-0062-4898-ad80-11865582bd07 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.796209 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 39/76] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:26 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:26.801184 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2502e1d1-6d80-44e1-8332-0d4e91a60b66 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:26.801978 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2502e1d1-6d80-44e1-8332-0d4e91a60b66 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:26.837202 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-12b2e332-9cfb-49c3-ae6a-75f665f1cbf3 req-f0b4eb07-0062-4898-ad80-11865582bd07 service nova] Creating event network-vif-plugged:8da9abd8-394d-4fcf-b31f-86f41ec75434 for instance b973684d-dabc-4073-9bd7-cfff6639d737 on hv-cinder-84327 May 25 16:08:26.846758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-12b2e332-9cfb-49c3-ae6a-75f665f1cbf3 req-f0b4eb07-0062-4898-ad80-11865582bd07 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.480796 May 25 16:08:26.847601 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 38/77] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:26.858818 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-aa6bfc12-b607-4a96-8cf8-3a88426f357a req-9b9ce8b7-e3a3-48c7-a820-f0603804072d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80a2c16-520b-48e9-9f83-e643414a8c8e", "tag": "4bf95a69-e3e3-4ef3-aeeb-8e9c69077969"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:26.869347 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-aa6bfc12-b607-4a96-8cf8-3a88426f357a req-9b9ce8b7-e3a3-48c7-a820-f0603804072d service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.870336 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-aa6bfc12-b607-4a96-8cf8-3a88426f357a req-9b9ce8b7-e3a3-48c7-a820-f0603804072d service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.883749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-aa6bfc12-b607-4a96-8cf8-3a88426f357a req-9b9ce8b7-e3a3-48c7-a820-f0603804072d service nova] Creating event network-changed:4bf95a69-e3e3-4ef3-aeeb-8e9c69077969 for instance e80a2c16-520b-48e9-9f83-e643414a8c8e on hv-cinder-84327 May 25 16:08:26.892213 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-aa6bfc12-b607-4a96-8cf8-3a88426f357a req-9b9ce8b7-e3a3-48c7-a820-f0603804072d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041263 May 25 16:08:26.893017 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 39/78] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:26.904615 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2502e1d1-6d80-44e1-8332-0d4e91a60b66 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:26.908525 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6c0dced4-4bf6-4f6f-b9ac-04569937db25 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:26.910216 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6c0dced4-4bf6-4f6f-b9ac-04569937db25 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:26.921461 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2502e1d1-6d80-44e1-8332-0d4e91a60b66 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1238 microversion: 2.1 time: 0.119947 May 25 16:08:26.923805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 40/79] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:26 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1238 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:26.941415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6c0dced4-4bf6-4f6f-b9ac-04569937db25 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.942163 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6c0dced4-4bf6-4f6f-b9ac-04569937db25 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:26.943220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6c0dced4-4bf6-4f6f-b9ac-04569937db25 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:26.943625 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6c0dced4-4bf6-4f6f-b9ac-04569937db25 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:27.144741 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7145ac3b-eae9-437a-99b2-c72c3cc4633c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:27.145370 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7145ac3b-eae9-437a-99b2-c72c3cc4633c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:27.154651 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7145ac3b-eae9-437a-99b2-c72c3cc4633c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:27.158787 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7145ac3b-eae9-437a-99b2-c72c3cc4633c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:27.159810 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7145ac3b-eae9-437a-99b2-c72c3cc4633c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:27.160406 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7145ac3b-eae9-437a-99b2-c72c3cc4633c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:27.403645 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6c0dced4-4bf6-4f6f-b9ac-04569937db25 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:27.412784 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6c0dced4-4bf6-4f6f-b9ac-04569937db25 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1322 microversion: 2.1 time: 0.518751 May 25 16:08:27.421427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 40/80] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:26 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:27.427745 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5a4e05b1-9659-4228-9cdd-abb362a8b436 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:27.428391 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5a4e05b1-9659-4228-9cdd-abb362a8b436 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:27.445912 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a4e05b1-9659-4228-9cdd-abb362a8b436 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:27.452527 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a4e05b1-9659-4228-9cdd-abb362a8b436 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:27.453548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a4e05b1-9659-4228-9cdd-abb362a8b436 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:27.453986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a4e05b1-9659-4228-9cdd-abb362a8b436 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:27.595092 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5a4e05b1-9659-4228-9cdd-abb362a8b436 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:27.604137 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5a4e05b1-9659-4228-9cdd-abb362a8b436 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1298 microversion: 2.1 time: 0.181533 May 25 16:08:27.607353 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 41/81] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:27 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1298 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:27.815540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:27.817426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:27.832534 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:27.833845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:27.835174 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:27.835905 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:27.857502 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7145ac3b-eae9-437a-99b2-c72c3cc4633c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:27.889039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7145ac3b-eae9-437a-99b2-c72c3cc4633c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 0.748432 May 25 16:08:27.892401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 41/82] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:27 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:27.938442 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-025101e0-8264-43d3-a758-807f62dc178b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:27.939340 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-025101e0-8264-43d3-a758-807f62dc178b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:27.947869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-025101e0-8264-43d3-a758-807f62dc178b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:27.948292 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-025101e0-8264-43d3-a758-807f62dc178b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:27.948989 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-025101e0-8264-43d3-a758-807f62dc178b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:27.950160 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-025101e0-8264-43d3-a758-807f62dc178b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:28.073995 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-025101e0-8264-43d3-a758-807f62dc178b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:28.079186 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=100 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:28.090380 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-025101e0-8264-43d3-a758-807f62dc178b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1290 microversion: 2.1 time: 0.155666 May 25 16:08:28.093855 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 42/83] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:27 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1290 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:28.207168 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:28.218162 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:28.222685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:28.224061 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0405e960-fff1-4a8d-b116-bc3c03dc656d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.412507 May 25 16:08:28.224776 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 42/84] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:27 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:28.430726 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-bc24f5af-7f3e-4113-9230-139da56ff3ea tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:28.431350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-bc24f5af-7f3e-4113-9230-139da56ff3ea tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:28.440049 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bc24f5af-7f3e-4113-9230-139da56ff3ea tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:28.440494 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bc24f5af-7f3e-4113-9230-139da56ff3ea tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:28.441282 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bc24f5af-7f3e-4113-9230-139da56ff3ea tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:28.462240 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bc24f5af-7f3e-4113-9230-139da56ff3ea tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:28.626099 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4b821df3-79ae-4138-9bb6-607025683660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:28.626916 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4b821df3-79ae-4138-9bb6-607025683660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:28.635298 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4b821df3-79ae-4138-9bb6-607025683660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:28.635680 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4b821df3-79ae-4138-9bb6-607025683660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:28.640722 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4b821df3-79ae-4138-9bb6-607025683660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:28.641180 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4b821df3-79ae-4138-9bb6-607025683660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:28.832592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-bc24f5af-7f3e-4113-9230-139da56ff3ea tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:28.842012 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-bc24f5af-7f3e-4113-9230-139da56ff3ea tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1322 microversion: 2.1 time: 0.415998 May 25 16:08:28.842924 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 43/85] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:28 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:28.875453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-a1840ece-219c-4acc-9cad-483f2a647d03 req-57515899-a10c-41ee-81fe-8efcb39e19a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6855067-d8ce-424f-b601-e0df21b52475", "name": "network-vif-plugged", "status": "completed", "tag": "e7a62f3c-e0c8-466c-b12b-f52f98992106"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:28.884963 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-a1840ece-219c-4acc-9cad-483f2a647d03 req-57515899-a10c-41ee-81fe-8efcb39e19a2 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:28.885406 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-a1840ece-219c-4acc-9cad-483f2a647d03 req-57515899-a10c-41ee-81fe-8efcb39e19a2 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:28.915200 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-a1840ece-219c-4acc-9cad-483f2a647d03 req-57515899-a10c-41ee-81fe-8efcb39e19a2 service nova] Creating event network-vif-plugged:e7a62f3c-e0c8-466c-b12b-f52f98992106 for instance b6855067-d8ce-424f-b601-e0df21b52475 on hv-cinder-84327 May 25 16:08:28.930125 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-a1840ece-219c-4acc-9cad-483f2a647d03 req-57515899-a10c-41ee-81fe-8efcb39e19a2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060004 May 25 16:08:28.931339 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 44/86] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:08:28.942662 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9e46c7e9-f8c9-499a-8fda-dbaa74345696 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:28.943530 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4b821df3-79ae-4138-9bb6-607025683660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:28.944578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9e46c7e9-f8c9-499a-8fda-dbaa74345696 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:28.952149 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4b821df3-79ae-4138-9bb6-607025683660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.332103 May 25 16:08:28.952733 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 43/87] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:28 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:28.967509 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9e46c7e9-f8c9-499a-8fda-dbaa74345696 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:28.968245 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9e46c7e9-f8c9-499a-8fda-dbaa74345696 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:28.971494 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9e46c7e9-f8c9-499a-8fda-dbaa74345696 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:28.972328 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9e46c7e9-f8c9-499a-8fda-dbaa74345696 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:29.110217 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c2003c83-3bfb-459c-a254-e0f09cbca30e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:29.110823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c2003c83-3bfb-459c-a254-e0f09cbca30e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:29.122087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c2003c83-3bfb-459c-a254-e0f09cbca30e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:29.122774 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c2003c83-3bfb-459c-a254-e0f09cbca30e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:29.123865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c2003c83-3bfb-459c-a254-e0f09cbca30e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:29.125963 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c2003c83-3bfb-459c-a254-e0f09cbca30e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:29.216908 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9e46c7e9-f8c9-499a-8fda-dbaa74345696 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:29.227082 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9e46c7e9-f8c9-499a-8fda-dbaa74345696 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 0.292959 May 25 16:08:29.229395 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 45/88] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:28 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:29.252778 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:29.253382 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:29.273747 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:29.279440 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:29.280485 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:29.282203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:29.292332 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c2003c83-3bfb-459c-a254-e0f09cbca30e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:29.295544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=100 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:29.310241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c2003c83-3bfb-459c-a254-e0f09cbca30e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1308 microversion: 2.1 time: 0.203415 May 25 16:08:29.326740 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 44/89] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:29 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:29.469544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-3ca50e26-390f-43f2-9550-6a9de5d5ec38 req-fbece23a-aba0-40fa-bbe3-5799ec3eb731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb52261b-f0d9-4cfc-a5df-dc306324060a", "tag": "149c600b-b80f-41a1-a754-cb48b95c5cb2"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:29.498816 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-3ca50e26-390f-43f2-9550-6a9de5d5ec38 req-fbece23a-aba0-40fa-bbe3-5799ec3eb731 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:29.501015 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-3ca50e26-390f-43f2-9550-6a9de5d5ec38 req-fbece23a-aba0-40fa-bbe3-5799ec3eb731 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:29.550974 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-3ca50e26-390f-43f2-9550-6a9de5d5ec38 req-fbece23a-aba0-40fa-bbe3-5799ec3eb731 service nova] Creating event network-changed:149c600b-b80f-41a1-a754-cb48b95c5cb2 for instance fb52261b-f0d9-4cfc-a5df-dc306324060a on hv-cinder-84327 May 25 16:08:29.556863 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:29.568053 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:29.568487 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-3ca50e26-390f-43f2-9550-6a9de5d5ec38 req-fbece23a-aba0-40fa-bbe3-5799ec3eb731 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102609 May 25 16:08:29.569952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:29.571406 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1ee475ac-a0e1-4795-917a-8328246c4704 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.322515 May 25 16:08:29.574747 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 45/90] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:29.583240 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 46/91] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:29 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:29.860803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1f6da917-35d2-4507-9dd7-790ea75b6177 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:29.868921 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1f6da917-35d2-4507-9dd7-790ea75b6177 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:29.889295 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f6da917-35d2-4507-9dd7-790ea75b6177 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:29.890793 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f6da917-35d2-4507-9dd7-790ea75b6177 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:29.893954 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f6da917-35d2-4507-9dd7-790ea75b6177 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:29.898685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f6da917-35d2-4507-9dd7-790ea75b6177 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:29.969062 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d17e7c36-b3e6-4ae7-aa96-d9c3f56eb68d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:29.970206 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d17e7c36-b3e6-4ae7-aa96-d9c3f56eb68d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:29.978008 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d17e7c36-b3e6-4ae7-aa96-d9c3f56eb68d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:29.979975 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d17e7c36-b3e6-4ae7-aa96-d9c3f56eb68d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:29.982011 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d17e7c36-b3e6-4ae7-aa96-d9c3f56eb68d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:29.982503 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d17e7c36-b3e6-4ae7-aa96-d9c3f56eb68d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:30.124714 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1f6da917-35d2-4507-9dd7-790ea75b6177 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:30.135444 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1f6da917-35d2-4507-9dd7-790ea75b6177 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1322 microversion: 2.1 time: 0.279992 May 25 16:08:30.136850 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 46/92] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:29 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:30.168670 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d17e7c36-b3e6-4ae7-aa96-d9c3f56eb68d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:30.178534 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d17e7c36-b3e6-4ae7-aa96-d9c3f56eb68d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.213402 May 25 16:08:30.179855 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 47/93] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:29 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:30.245484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-64d6ad65-cf52-4c51-83f5-bc82af0db912 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:30.246350 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-64d6ad65-cf52-4c51-83f5-bc82af0db912 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:30.253567 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64d6ad65-cf52-4c51-83f5-bc82af0db912 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:30.254093 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64d6ad65-cf52-4c51-83f5-bc82af0db912 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:30.254933 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64d6ad65-cf52-4c51-83f5-bc82af0db912 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:30.255418 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64d6ad65-cf52-4c51-83f5-bc82af0db912 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:30.328414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a75b04d9-f6c9-4d0c-a5d3-c16991fb7c9a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:30.329385 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a75b04d9-f6c9-4d0c-a5d3-c16991fb7c9a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:30.338350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a75b04d9-f6c9-4d0c-a5d3-c16991fb7c9a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:30.339080 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a75b04d9-f6c9-4d0c-a5d3-c16991fb7c9a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:30.340124 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a75b04d9-f6c9-4d0c-a5d3-c16991fb7c9a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:30.340675 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a75b04d9-f6c9-4d0c-a5d3-c16991fb7c9a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:30.535555 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a75b04d9-f6c9-4d0c-a5d3-c16991fb7c9a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:30.549828 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a75b04d9-f6c9-4d0c-a5d3-c16991fb7c9a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1296 microversion: 2.1 time: 0.225350 May 25 16:08:30.552733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 48/94] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:30 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1296 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:30.592926 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:30.593981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:30.605214 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:30.606018 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:30.607907 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:30.608589 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:30.917099 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:30.932128 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:30.933526 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:30.934732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-cb2be58b-e723-4405-bd5a-1c7b89c26b97 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.348309 May 25 16:08:30.951214 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 49/95] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:30 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:30.956326 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-68f80dcc-ba80-4b5f-854d-3d49c6015365 req-cc4d45fd-a0cb-4211-b4b2-64c3d6ae704a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f650730-0534-4f4b-92b9-6d6be8cc54c7", "name": "network-vif-plugged", "status": "completed", "tag": "5e831b32-3912-4fc5-8b80-9b3a1edda724"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:30.965218 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-68f80dcc-ba80-4b5f-854d-3d49c6015365 req-cc4d45fd-a0cb-4211-b4b2-64c3d6ae704a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:30.966215 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-68f80dcc-ba80-4b5f-854d-3d49c6015365 req-cc4d45fd-a0cb-4211-b4b2-64c3d6ae704a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:30.978475 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-68f80dcc-ba80-4b5f-854d-3d49c6015365 req-cc4d45fd-a0cb-4211-b4b2-64c3d6ae704a service nova] Creating event network-vif-plugged:5e831b32-3912-4fc5-8b80-9b3a1edda724 for instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 on hv-cinder-84327 May 25 16:08:30.984354 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-68f80dcc-ba80-4b5f-854d-3d49c6015365 req-cc4d45fd-a0cb-4211-b4b2-64c3d6ae704a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031484 May 25 16:08:30.989552 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 50/96] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:31.000128 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-64d6ad65-cf52-4c51-83f5-bc82af0db912 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:31.016110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-64d6ad65-cf52-4c51-83f5-bc82af0db912 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 0.774178 May 25 16:08:31.017628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 47/97] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:30 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:31.160171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-06cb9447-b4c7-41f9-9a20-331826fda462 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:31.161217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-06cb9447-b4c7-41f9-9a20-331826fda462 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:31.172588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-06cb9447-b4c7-41f9-9a20-331826fda462 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:31.173446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-06cb9447-b4c7-41f9-9a20-331826fda462 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:31.174436 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-06cb9447-b4c7-41f9-9a20-331826fda462 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:31.175393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-06cb9447-b4c7-41f9-9a20-331826fda462 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:31.198586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b42d3a27-b192-42e1-b25b-556f25c8e87d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:31.199440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b42d3a27-b192-42e1-b25b-556f25c8e87d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:31.204020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=6 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:31.232271 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b42d3a27-b192-42e1-b25b-556f25c8e87d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:31.233110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b42d3a27-b192-42e1-b25b-556f25c8e87d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:31.236053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b42d3a27-b192-42e1-b25b-556f25c8e87d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:31.238373 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b42d3a27-b192-42e1-b25b-556f25c8e87d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:31.527106 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b42d3a27-b192-42e1-b25b-556f25c8e87d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:31.537741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b42d3a27-b192-42e1-b25b-556f25c8e87d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.343792 May 25 16:08:31.539707 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 48/98] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:31 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:31.569442 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2a2940ea-2571-49f8-ad41-067b7d1390a9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:31.570721 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2a2940ea-2571-49f8-ad41-067b7d1390a9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:31.584289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2a2940ea-2571-49f8-ad41-067b7d1390a9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:31.587759 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2a2940ea-2571-49f8-ad41-067b7d1390a9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:31.590146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2a2940ea-2571-49f8-ad41-067b7d1390a9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:31.590807 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2a2940ea-2571-49f8-ad41-067b7d1390a9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:31.599380 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-06cb9447-b4c7-41f9-9a20-331826fda462 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:31.613846 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-06cb9447-b4c7-41f9-9a20-331826fda462 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1517 microversion: 2.1 time: 0.462201 May 25 16:08:31.614424 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 51/99] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:31 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1517 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:31.633723 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-584a252e-19aa-449f-bc4d-296ee764f559 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:31.634723 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-584a252e-19aa-449f-bc4d-296ee764f559 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:31.651489 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-584a252e-19aa-449f-bc4d-296ee764f559 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:31.651955 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-584a252e-19aa-449f-bc4d-296ee764f559 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:31.652720 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-584a252e-19aa-449f-bc4d-296ee764f559 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:31.653145 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-584a252e-19aa-449f-bc4d-296ee764f559 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:31.685120 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2a2940ea-2571-49f8-ad41-067b7d1390a9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:31.697482 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2a2940ea-2571-49f8-ad41-067b7d1390a9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1296 microversion: 2.1 time: 0.133990 May 25 16:08:31.698559 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 49/100] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:31 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1296 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:31.745675 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-584a252e-19aa-449f-bc4d-296ee764f559 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lazy-loading 'flavor' on Instance uuid b973684d-dabc-4073-9bd7-cfff6639d737 {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:08:31.964878 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:31.969965 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:31.983071 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:31.995525 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:31.999389 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:32.002666 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:32.270149 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-584a252e-19aa-449f-bc4d-296ee764f559 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737/action" status: 200 len: 32 microversion: 2.1 time: 0.640720 May 25 16:08:32.273190 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 52/101] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:08:31 2022] POST /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737/action => generated 32 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:08:32.281368 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7cac00a1-7457-43c6-a5ed-5cdd025856c4 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:32.282248 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7cac00a1-7457-43c6-a5ed-5cdd025856c4 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:32.306047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7cac00a1-7457-43c6-a5ed-5cdd025856c4 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:32.306506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7cac00a1-7457-43c6-a5ed-5cdd025856c4 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:32.307405 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7cac00a1-7457-43c6-a5ed-5cdd025856c4 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:32.311089 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7cac00a1-7457-43c6-a5ed-5cdd025856c4 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:32.455104 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:32.464259 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:32.466257 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:32.467482 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-43eba501-9131-48d5-8124-46d3727249de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.511076 May 25 16:08:32.475905 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 50/102] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:31 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:08:32.480681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0f22375f-da33-4eb0-9974-956e7f72bcb1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:32.481601 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0f22375f-da33-4eb0-9974-956e7f72bcb1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:32.489331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0f22375f-da33-4eb0-9974-956e7f72bcb1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:32.489983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0f22375f-da33-4eb0-9974-956e7f72bcb1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:32.490932 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0f22375f-da33-4eb0-9974-956e7f72bcb1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:32.491666 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0f22375f-da33-4eb0-9974-956e7f72bcb1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:32.647972 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7cac00a1-7457-43c6-a5ed-5cdd025856c4 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:32.661557 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7cac00a1-7457-43c6-a5ed-5cdd025856c4 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1315 microversion: 2.1 time: 0.384553 May 25 16:08:32.662731 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 53/103] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:32 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:32.674798 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ba90e5e4-e7b9-4370-8348-40721d666325 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:32.676900 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ba90e5e4-e7b9-4370-8348-40721d666325 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:32.686641 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0f22375f-da33-4eb0-9974-956e7f72bcb1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:32.692452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ba90e5e4-e7b9-4370-8348-40721d666325 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:32.693067 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ba90e5e4-e7b9-4370-8348-40721d666325 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:32.695298 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ba90e5e4-e7b9-4370-8348-40721d666325 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:32.695861 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ba90e5e4-e7b9-4370-8348-40721d666325 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:32.698409 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0f22375f-da33-4eb0-9974-956e7f72bcb1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.221359 May 25 16:08:32.711585 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 51/104] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:32 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:32.726452 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ccd4989c-2c51-4403-bf09-6e5060712baf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:32.727080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ccd4989c-2c51-4403-bf09-6e5060712baf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:32.744618 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ccd4989c-2c51-4403-bf09-6e5060712baf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:32.748212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ccd4989c-2c51-4403-bf09-6e5060712baf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:32.749094 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ccd4989c-2c51-4403-bf09-6e5060712baf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:32.749541 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ccd4989c-2c51-4403-bf09-6e5060712baf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:33.216850 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ba90e5e4-e7b9-4370-8348-40721d666325 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:33.234604 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ba90e5e4-e7b9-4370-8348-40721d666325 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.566267 May 25 16:08:33.235404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 54/105] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:32 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:33.302671 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ccd4989c-2c51-4403-bf09-6e5060712baf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:33.315419 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ccd4989c-2c51-4403-bf09-6e5060712baf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.602683 May 25 16:08:33.319213 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 52/106] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:32 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:33.449911 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-d4c71df5-0eaf-413d-8b56-02e39a679d1c req-c6dec758-3199-44db-8b09-1e22cc6e3130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80a2c16-520b-48e9-9f83-e643414a8c8e", "name": "network-vif-plugged", "status": "completed", "tag": "4bf95a69-e3e3-4ef3-aeeb-8e9c69077969"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:33.469110 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-d4c71df5-0eaf-413d-8b56-02e39a679d1c req-c6dec758-3199-44db-8b09-1e22cc6e3130 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:33.471978 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-d4c71df5-0eaf-413d-8b56-02e39a679d1c req-c6dec758-3199-44db-8b09-1e22cc6e3130 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:33.488262 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:33.489676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:33.511180 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:33.512880 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:33.514328 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:33.515945 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:33.539555 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-d4c71df5-0eaf-413d-8b56-02e39a679d1c req-c6dec758-3199-44db-8b09-1e22cc6e3130 service nova] Creating event network-vif-plugged:4bf95a69-e3e3-4ef3-aeeb-8e9c69077969 for instance e80a2c16-520b-48e9-9f83-e643414a8c8e on hv-cinder-84327 May 25 16:08:33.560282 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-d4c71df5-0eaf-413d-8b56-02e39a679d1c req-c6dec758-3199-44db-8b09-1e22cc6e3130 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109441 May 25 16:08:33.561241 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 55/107] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:33.675690 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-533fb979-96d1-4863-ac86-85b57bbe9bc3 req-0f7ab57e-9225-4a96-84ad-b7876264f910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c5f2914-854d-4d77-82e5-680200d4d6c8", "tag": "ba260aab-9e99-4e6c-ad1d-fdc814dca2d5"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:33.695882 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-533fb979-96d1-4863-ac86-85b57bbe9bc3 req-0f7ab57e-9225-4a96-84ad-b7876264f910 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:33.700463 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-533fb979-96d1-4863-ac86-85b57bbe9bc3 req-0f7ab57e-9225-4a96-84ad-b7876264f910 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:33.719534 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-533fb979-96d1-4863-ac86-85b57bbe9bc3 req-0f7ab57e-9225-4a96-84ad-b7876264f910 service nova] Creating event network-changed:ba260aab-9e99-4e6c-ad1d-fdc814dca2d5 for instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 on hv-cinder-84327 May 25 16:08:33.726394 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-533fb979-96d1-4863-ac86-85b57bbe9bc3 req-0f7ab57e-9225-4a96-84ad-b7876264f910 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057533 May 25 16:08:33.727238 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 56/108] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:08:33.734375 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6c9df3aa-1fea-4991-a3ad-ac1a417f9589 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:33.736157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-6c9df3aa-1fea-4991-a3ad-ac1a417f9589 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:33.746995 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6c9df3aa-1fea-4991-a3ad-ac1a417f9589 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:33.749418 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6c9df3aa-1fea-4991-a3ad-ac1a417f9589 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:33.750528 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6c9df3aa-1fea-4991-a3ad-ac1a417f9589 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:33.751240 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6c9df3aa-1fea-4991-a3ad-ac1a417f9589 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:33.938636 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:33.953714 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:33.959554 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:33.960972 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-aa878a32-8ea5-40d5-9fe5-50d5ffb2ac73 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.478099 May 25 16:08:33.961617 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 53/109] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:33 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:33.977845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ffcf04e7-5602-416d-ab45-0ebb98e97bac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:33.978758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ffcf04e7-5602-416d-ab45-0ebb98e97bac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:33.985057 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ffcf04e7-5602-416d-ab45-0ebb98e97bac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:33.985506 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ffcf04e7-5602-416d-ab45-0ebb98e97bac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:33.986347 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ffcf04e7-5602-416d-ab45-0ebb98e97bac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:33.986720 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ffcf04e7-5602-416d-ab45-0ebb98e97bac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:34.154367 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-6c9df3aa-1fea-4991-a3ad-ac1a417f9589 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:34.169484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6c9df3aa-1fea-4991-a3ad-ac1a417f9589 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1501 microversion: 2.1 time: 0.439334 May 25 16:08:34.171761 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 57/110] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:33 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1501 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:34.255696 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d872985d-5d56-4bd8-b68a-0e720cc3ef92 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:34.257192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d872985d-5d56-4bd8-b68a-0e720cc3ef92 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:34.269477 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d872985d-5d56-4bd8-b68a-0e720cc3ef92 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:34.270744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d872985d-5d56-4bd8-b68a-0e720cc3ef92 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:34.271190 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d872985d-5d56-4bd8-b68a-0e720cc3ef92 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:34.272232 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d872985d-5d56-4bd8-b68a-0e720cc3ef92 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:34.368835 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ffcf04e7-5602-416d-ab45-0ebb98e97bac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:34.380840 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ffcf04e7-5602-416d-ab45-0ebb98e97bac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.407115 May 25 16:08:34.384929 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 54/111] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:33 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:34.395725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-40858366-ed4b-482d-8f98-0e7932d4ebfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:34.396379 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-40858366-ed4b-482d-8f98-0e7932d4ebfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:34.422321 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40858366-ed4b-482d-8f98-0e7932d4ebfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:34.422816 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40858366-ed4b-482d-8f98-0e7932d4ebfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:34.423600 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40858366-ed4b-482d-8f98-0e7932d4ebfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:34.424058 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40858366-ed4b-482d-8f98-0e7932d4ebfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:34.468054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d872985d-5d56-4bd8-b68a-0e720cc3ef92 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:34.477729 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d872985d-5d56-4bd8-b68a-0e720cc3ef92 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.226871 May 25 16:08:34.484057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 58/112] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:34 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:34.634325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-40858366-ed4b-482d-8f98-0e7932d4ebfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:34.645513 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-40858366-ed4b-482d-8f98-0e7932d4ebfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.259294 May 25 16:08:34.649301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 55/113] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:34 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:34.982220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:34.983533 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:34.991440 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:34.994312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:34.995427 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:34.996616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:35.169163 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:35.178886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:35.180805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:35.182112 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8c71414a-3d17-4ed8-a9dd-4cb4c567b51d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.204913 May 25 16:08:35.182670 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 59/114] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:34 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:35.397654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1e210770-43ba-48a3-9120-1e3960ab63cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:35.398269 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1e210770-43ba-48a3-9120-1e3960ab63cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:35.400294 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:35.418287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1e210770-43ba-48a3-9120-1e3960ab63cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:35.421520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1e210770-43ba-48a3-9120-1e3960ab63cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:35.422550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1e210770-43ba-48a3-9120-1e3960ab63cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:35.423191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1e210770-43ba-48a3-9120-1e3960ab63cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:35.501071 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5acf1181-0af5-43f8-8763-b8c99bd573cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:35.501679 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5acf1181-0af5-43f8-8763-b8c99bd573cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:35.508693 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5acf1181-0af5-43f8-8763-b8c99bd573cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:35.509145 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5acf1181-0af5-43f8-8763-b8c99bd573cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:35.509987 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5acf1181-0af5-43f8-8763-b8c99bd573cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:35.510489 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5acf1181-0af5-43f8-8763-b8c99bd573cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:35.533270 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:35.583272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1e210770-43ba-48a3-9120-1e3960ab63cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:35.592746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1e210770-43ba-48a3-9120-1e3960ab63cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.199106 May 25 16:08:35.593319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 56/115] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:35 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:35.666550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-64a555fd-3308-4a65-94e0-e3c501e8569a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:35.667196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-64a555fd-3308-4a65-94e0-e3c501e8569a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:35.670947 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5acf1181-0af5-43f8-8763-b8c99bd573cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:35.679983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64a555fd-3308-4a65-94e0-e3c501e8569a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:35.682262 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64a555fd-3308-4a65-94e0-e3c501e8569a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:35.684718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5acf1181-0af5-43f8-8763-b8c99bd573cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.187790 May 25 16:08:35.685680 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64a555fd-3308-4a65-94e0-e3c501e8569a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:35.686147 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64a555fd-3308-4a65-94e0-e3c501e8569a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:35.690744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 60/116] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:35 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:35.841113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-bdefa53b-af7d-4f28-b879-e6bc98d3b551 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b43039a3-52ad-4f76-a7f7-245f2f513d51"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:35.842430 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-bdefa53b-af7d-4f28-b879-e6bc98d3b551 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:35.850090 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bdefa53b-af7d-4f28-b879-e6bc98d3b551 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:35.851619 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bdefa53b-af7d-4f28-b879-e6bc98d3b551 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:35.852594 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bdefa53b-af7d-4f28-b879-e6bc98d3b551 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:35.853200 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bdefa53b-af7d-4f28-b879-e6bc98d3b551 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:35.885314 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-64a555fd-3308-4a65-94e0-e3c501e8569a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:35.897748 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-64a555fd-3308-4a65-94e0-e3c501e8569a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.236224 May 25 16:08:35.900441 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 57/117] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:35 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:36.200931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:36.201529 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:36.220103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:36.220103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:36.220103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:36.220103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:36.338951 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:36.394298 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:36.405773 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:36.407882 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:36.409539 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4dd9f29c-6049-4e8e-b1c5-7c97cab62d89 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1407 microversion: 2.20 time: 0.213572 May 25 16:08:36.410378 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 58/118] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:36 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:08:36.611555 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2c6b70bb-cd2a-4363-8b51-f2841a5a8c84 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:36.612713 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2c6b70bb-cd2a-4363-8b51-f2841a5a8c84 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:36.619849 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2c6b70bb-cd2a-4363-8b51-f2841a5a8c84 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:36.620534 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2c6b70bb-cd2a-4363-8b51-f2841a5a8c84 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:36.634074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2c6b70bb-cd2a-4363-8b51-f2841a5a8c84 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:36.634637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2c6b70bb-cd2a-4363-8b51-f2841a5a8c84 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:36.821855 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2c6b70bb-cd2a-4363-8b51-f2841a5a8c84 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:36.830191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2c6b70bb-cd2a-4363-8b51-f2841a5a8c84 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.224587 May 25 16:08:36.832546 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 59/119] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:36 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:36.837403 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-03fc1e9b-2cfb-431d-a2ea-de8c9fc4ebf8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:36.838005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-03fc1e9b-2cfb-431d-a2ea-de8c9fc4ebf8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:36.845891 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-03fc1e9b-2cfb-431d-a2ea-de8c9fc4ebf8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:36.846376 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-03fc1e9b-2cfb-431d-a2ea-de8c9fc4ebf8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:36.847317 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-03fc1e9b-2cfb-431d-a2ea-de8c9fc4ebf8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:36.847746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-03fc1e9b-2cfb-431d-a2ea-de8c9fc4ebf8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:36.916765 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=13 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:37.012248 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-bdefa53b-af7d-4f28-b879-e6bc98d3b551 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "POST /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.175057 May 25 16:08:37.013068 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 61/120] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:08:35 2022] POST /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475/os-volume_attachments => generated 194 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:08:37.018981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-67962fb1-18d2-49b9-befa-9fa4ce22a95c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:37.019771 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-67962fb1-18d2-49b9-befa-9fa4ce22a95c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:37.027334 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67962fb1-18d2-49b9-befa-9fa4ce22a95c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:37.027775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67962fb1-18d2-49b9-befa-9fa4ce22a95c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:37.029131 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67962fb1-18d2-49b9-befa-9fa4ce22a95c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:37.029843 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67962fb1-18d2-49b9-befa-9fa4ce22a95c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:37.052382 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-03fc1e9b-2cfb-431d-a2ea-de8c9fc4ebf8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:37.061765 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-03fc1e9b-2cfb-431d-a2ea-de8c9fc4ebf8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.227954 May 25 16:08:37.063941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 60/121] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:36 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:37.188247 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-67962fb1-18d2-49b9-befa-9fa4ce22a95c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:37.196217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-67962fb1-18d2-49b9-befa-9fa4ce22a95c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.181756 May 25 16:08:37.197308 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 62/122] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:37 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:37.437198 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:37.438234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:37.446628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:37.447192 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:37.448152 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:37.448699 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:37.615401 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:37.624953 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:37.627329 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:37.629325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-579c3ca6-5e10-432b-ac91-9c94d116df7c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1599 microversion: 2.20 time: 0.197627 May 25 16:08:37.630031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 61/123] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:08:37 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1599 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:08:37.659118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5ec971dd-c039-4047-b3e3-f2c084bac0ce tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:37.659942 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5ec971dd-c039-4047-b3e3-f2c084bac0ce tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:37.666859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ec971dd-c039-4047-b3e3-f2c084bac0ce tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:37.667718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ec971dd-c039-4047-b3e3-f2c084bac0ce tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:37.668832 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ec971dd-c039-4047-b3e3-f2c084bac0ce tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:37.670109 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ec971dd-c039-4047-b3e3-f2c084bac0ce tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:37.783806 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5ec971dd-c039-4047-b3e3-f2c084bac0ce tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.139141 May 25 16:08:37.790211 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 63/124] 10.222.0.85 () {60 vars in 1315 bytes} [Wed May 25 16:08:37 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:08:37.850478 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f05c7a88-a296-404d-9e55-bb427d539b81 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:37.851161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f05c7a88-a296-404d-9e55-bb427d539b81 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:37.858211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f05c7a88-a296-404d-9e55-bb427d539b81 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:37.858888 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f05c7a88-a296-404d-9e55-bb427d539b81 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:37.862672 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f05c7a88-a296-404d-9e55-bb427d539b81 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:37.863322 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f05c7a88-a296-404d-9e55-bb427d539b81 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:37.876483 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=100 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:38.080986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3d3efb6f-6277-49bf-a1ad-6f644592688c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:38.081763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3d3efb6f-6277-49bf-a1ad-6f644592688c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:38.090401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d3efb6f-6277-49bf-a1ad-6f644592688c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:38.091166 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d3efb6f-6277-49bf-a1ad-6f644592688c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:38.092367 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d3efb6f-6277-49bf-a1ad-6f644592688c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:38.093210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d3efb6f-6277-49bf-a1ad-6f644592688c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:38.267922 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3d3efb6f-6277-49bf-a1ad-6f644592688c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:38.276981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3d3efb6f-6277-49bf-a1ad-6f644592688c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.200297 May 25 16:08:38.278789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 64/125] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:38 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:38.284098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-63ef6450-f719-4105-9a56-0e8586d8a5f3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:38.285073 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-63ef6450-f719-4105-9a56-0e8586d8a5f3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:38.292228 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-63ef6450-f719-4105-9a56-0e8586d8a5f3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:38.292975 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-63ef6450-f719-4105-9a56-0e8586d8a5f3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:38.293967 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-63ef6450-f719-4105-9a56-0e8586d8a5f3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:38.294643 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-63ef6450-f719-4105-9a56-0e8586d8a5f3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:38.448744 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f05c7a88-a296-404d-9e55-bb427d539b81 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:38.457116 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f05c7a88-a296-404d-9e55-bb427d539b81 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.611441 May 25 16:08:38.457959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 62/126] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:37 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:38.519388 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-63ef6450-f719-4105-9a56-0e8586d8a5f3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:38.528894 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-63ef6450-f719-4105-9a56-0e8586d8a5f3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.248105 May 25 16:08:38.529920 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 65/127] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:38 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:39.295544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-11bbb87f-12b1-44fe-a342-3bc2a95de02f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:39.295544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-11bbb87f-12b1-44fe-a342-3bc2a95de02f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:39.311681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-11bbb87f-12b1-44fe-a342-3bc2a95de02f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:39.318436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-11bbb87f-12b1-44fe-a342-3bc2a95de02f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:39.319596 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-11bbb87f-12b1-44fe-a342-3bc2a95de02f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:39.319878 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-11bbb87f-12b1-44fe-a342-3bc2a95de02f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:39.476263 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3ab2afad-2128-45d2-a115-e0a14df640b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:39.476726 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3ab2afad-2128-45d2-a115-e0a14df640b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:39.494860 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3ab2afad-2128-45d2-a115-e0a14df640b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:39.495318 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3ab2afad-2128-45d2-a115-e0a14df640b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:39.496139 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3ab2afad-2128-45d2-a115-e0a14df640b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:39.504327 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3ab2afad-2128-45d2-a115-e0a14df640b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:39.783245 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-11bbb87f-12b1-44fe-a342-3bc2a95de02f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:39.797114 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-11bbb87f-12b1-44fe-a342-3bc2a95de02f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.505275 May 25 16:08:39.798400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 63/128] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:39 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:39.803762 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-93714430-4ac7-4d61-9d2f-6cc116e92252 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:39.805510 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-93714430-4ac7-4d61-9d2f-6cc116e92252 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:39.813277 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-93714430-4ac7-4d61-9d2f-6cc116e92252 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:39.814219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-93714430-4ac7-4d61-9d2f-6cc116e92252 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:39.815139 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-93714430-4ac7-4d61-9d2f-6cc116e92252 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:39.816185 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-93714430-4ac7-4d61-9d2f-6cc116e92252 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:39.826516 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3ab2afad-2128-45d2-a115-e0a14df640b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:39.836999 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3ab2afad-2128-45d2-a115-e0a14df640b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.364951 May 25 16:08:39.838166 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 66/129] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:39 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:39.852276 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-61575776-b22f-43eb-bc0c-0ce410674e05 req-a82c1aae-bd2c-40dc-984f-0bc3d3dcecdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80a2c16-520b-48e9-9f83-e643414a8c8e", "tag": "4bf95a69-e3e3-4ef3-aeeb-8e9c69077969"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:39.862900 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:39.866479 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-61575776-b22f-43eb-bc0c-0ce410674e05 req-a82c1aae-bd2c-40dc-984f-0bc3d3dcecdc service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:39.867247 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-61575776-b22f-43eb-bc0c-0ce410674e05 req-a82c1aae-bd2c-40dc-984f-0bc3d3dcecdc service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:39.887871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-61575776-b22f-43eb-bc0c-0ce410674e05 req-a82c1aae-bd2c-40dc-984f-0bc3d3dcecdc service nova] Creating event network-changed:4bf95a69-e3e3-4ef3-aeeb-8e9c69077969 for instance e80a2c16-520b-48e9-9f83-e643414a8c8e on hv-cinder-84327 May 25 16:08:39.895025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-61575776-b22f-43eb-bc0c-0ce410674e05 req-a82c1aae-bd2c-40dc-984f-0bc3d3dcecdc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055050 May 25 16:08:39.897275 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 67/130] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:39.904836 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-e1a4044a-c33b-462b-b679-08c5d4ac19e4 req-5fe7d893-beec-40e4-97ad-23547a3b3ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb52261b-f0d9-4cfc-a5df-dc306324060a", "name": "network-vif-plugged", "status": "completed", "tag": "149c600b-b80f-41a1-a754-cb48b95c5cb2"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:39.916013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-e1a4044a-c33b-462b-b679-08c5d4ac19e4 req-5fe7d893-beec-40e4-97ad-23547a3b3ec0 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:39.916835 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-e1a4044a-c33b-462b-b679-08c5d4ac19e4 req-5fe7d893-beec-40e4-97ad-23547a3b3ec0 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:39.930361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-e1a4044a-c33b-462b-b679-08c5d4ac19e4 req-5fe7d893-beec-40e4-97ad-23547a3b3ec0 service nova] Creating event network-vif-plugged:149c600b-b80f-41a1-a754-cb48b95c5cb2 for instance fb52261b-f0d9-4cfc-a5df-dc306324060a on hv-cinder-84327 May 25 16:08:39.935927 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-e1a4044a-c33b-462b-b679-08c5d4ac19e4 req-5fe7d893-beec-40e4-97ad-23547a3b3ec0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036799 May 25 16:08:39.938187 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 68/131] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:40.219793 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-93714430-4ac7-4d61-9d2f-6cc116e92252 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:40.227755 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-93714430-4ac7-4d61-9d2f-6cc116e92252 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.428060 May 25 16:08:40.231084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 64/132] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:39 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:40.815840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8dc63069-1774-4a59-91d2-6148b42d1648 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:40.816739 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8dc63069-1774-4a59-91d2-6148b42d1648 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:40.823763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8dc63069-1774-4a59-91d2-6148b42d1648 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:40.824444 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8dc63069-1774-4a59-91d2-6148b42d1648 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:40.825232 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8dc63069-1774-4a59-91d2-6148b42d1648 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:40.825666 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8dc63069-1774-4a59-91d2-6148b42d1648 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:40.855857 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b023c914-20f4-4183-b5a2-71615d934fef tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:40.857226 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b023c914-20f4-4183-b5a2-71615d934fef tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:40.867117 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b023c914-20f4-4183-b5a2-71615d934fef tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:40.867560 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b023c914-20f4-4183-b5a2-71615d934fef tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:40.868508 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b023c914-20f4-4183-b5a2-71615d934fef tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:40.868977 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b023c914-20f4-4183-b5a2-71615d934fef tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:41.039214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b023c914-20f4-4183-b5a2-71615d934fef tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:41.048117 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b023c914-20f4-4183-b5a2-71615d934fef tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.197276 May 25 16:08:41.048694 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 65/133] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:40 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:41.103051 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-8dc63069-1774-4a59-91d2-6148b42d1648 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:41.105456 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8dc63069-1774-4a59-91d2-6148b42d1648 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1366 microversion: 2.1 time: 0.293926 May 25 16:08:41.109592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 69/134] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:40 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:41.250630 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5bdf9f55-a518-4bb8-b294-bae7f5152281 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:41.251665 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5bdf9f55-a518-4bb8-b294-bae7f5152281 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:41.262142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5bdf9f55-a518-4bb8-b294-bae7f5152281 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:41.263682 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5bdf9f55-a518-4bb8-b294-bae7f5152281 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:41.264668 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5bdf9f55-a518-4bb8-b294-bae7f5152281 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:41.265217 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5bdf9f55-a518-4bb8-b294-bae7f5152281 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:41.478413 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5bdf9f55-a518-4bb8-b294-bae7f5152281 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:41.496377 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5bdf9f55-a518-4bb8-b294-bae7f5152281 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.249601 May 25 16:08:41.509374 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 66/135] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:41 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:42.050980 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-f7be0d7d-500b-4fc4-9c8b-b4cbc143f319 req-c393dc24-595a-489f-85e1-42fedf3fb884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c5f2914-854d-4d77-82e5-680200d4d6c8", "name": "network-vif-plugged", "status": "completed", "tag": "ba260aab-9e99-4e6c-ad1d-fdc814dca2d5"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:42.065922 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8c93c0eb-7511-43a4-a1c8-61de0a43082b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:42.067914 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8c93c0eb-7511-43a4-a1c8-61de0a43082b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:42.077248 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8c93c0eb-7511-43a4-a1c8-61de0a43082b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:42.080546 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8c93c0eb-7511-43a4-a1c8-61de0a43082b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:42.084961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8c93c0eb-7511-43a4-a1c8-61de0a43082b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:42.085412 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8c93c0eb-7511-43a4-a1c8-61de0a43082b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:42.089762 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-f7be0d7d-500b-4fc4-9c8b-b4cbc143f319 req-c393dc24-595a-489f-85e1-42fedf3fb884 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:42.090214 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-f7be0d7d-500b-4fc4-9c8b-b4cbc143f319 req-c393dc24-595a-489f-85e1-42fedf3fb884 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:42.122195 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-f7be0d7d-500b-4fc4-9c8b-b4cbc143f319 req-c393dc24-595a-489f-85e1-42fedf3fb884 service nova] Creating event network-vif-plugged:ba260aab-9e99-4e6c-ad1d-fdc814dca2d5 for instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 on hv-cinder-84327 May 25 16:08:42.136880 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-f7be0d7d-500b-4fc4-9c8b-b4cbc143f319 req-c393dc24-595a-489f-85e1-42fedf3fb884 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089418 May 25 16:08:42.138906 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 70/136] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:08:42.146630 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-542cfceb-196b-4d04-9766-b337a55b0e33 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:42.148157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-542cfceb-196b-4d04-9766-b337a55b0e33 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:42.158264 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-542cfceb-196b-4d04-9766-b337a55b0e33 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:42.158799 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-542cfceb-196b-4d04-9766-b337a55b0e33 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:42.159805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-542cfceb-196b-4d04-9766-b337a55b0e33 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:42.160219 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-542cfceb-196b-4d04-9766-b337a55b0e33 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:42.359805 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-8c93c0eb-7511-43a4-a1c8-61de0a43082b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:42.369116 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8c93c0eb-7511-43a4-a1c8-61de0a43082b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.307647 May 25 16:08:42.378954 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-542cfceb-196b-4d04-9766-b337a55b0e33 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:42.379807 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 67/137] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:42 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:42.384154 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-542cfceb-196b-4d04-9766-b337a55b0e33 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1555 microversion: 2.1 time: 0.243929 May 25 16:08:42.384771 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 71/138] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:42 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:42.405715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-856fac10-e541-432e-b523-fb847089d578 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:42.406459 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-856fac10-e541-432e-b523-fb847089d578 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:42.413737 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-856fac10-e541-432e-b523-fb847089d578 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:42.414901 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-856fac10-e541-432e-b523-fb847089d578 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:42.416005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-856fac10-e541-432e-b523-fb847089d578 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:42.416717 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-856fac10-e541-432e-b523-fb847089d578 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:42.514338 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e783fe75-d640-44c2-aafa-fe27166fa8c3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:42.514951 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e783fe75-d640-44c2-aafa-fe27166fa8c3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:42.521932 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e783fe75-d640-44c2-aafa-fe27166fa8c3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:42.522635 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e783fe75-d640-44c2-aafa-fe27166fa8c3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:42.523551 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e783fe75-d640-44c2-aafa-fe27166fa8c3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:42.524229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e783fe75-d640-44c2-aafa-fe27166fa8c3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:42.549221 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-856fac10-e541-432e-b523-fb847089d578 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149032 May 25 16:08:42.550377 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 68/139] 10.222.0.85 () {58 vars in 1274 bytes} [Wed May 25 16:08:42 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:42.738991 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e783fe75-d640-44c2-aafa-fe27166fa8c3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:42.751177 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e783fe75-d640-44c2-aafa-fe27166fa8c3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.240932 May 25 16:08:42.752104 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 72/140] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:42 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:43.386267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a9b5966b-b34e-4b0b-a806-eb2a01be8b58 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:43.388144 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a9b5966b-b34e-4b0b-a806-eb2a01be8b58 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:43.395584 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a9b5966b-b34e-4b0b-a806-eb2a01be8b58 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:43.396072 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a9b5966b-b34e-4b0b-a806-eb2a01be8b58 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:43.397077 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a9b5966b-b34e-4b0b-a806-eb2a01be8b58 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:43.397823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a9b5966b-b34e-4b0b-a806-eb2a01be8b58 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:43.680164 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a9b5966b-b34e-4b0b-a806-eb2a01be8b58 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:43.691178 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a9b5966b-b34e-4b0b-a806-eb2a01be8b58 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.309164 May 25 16:08:43.700880 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 69/141] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:43 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:43.769904 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9083fc22-26b6-4515-8698-40d240e81253 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:43.770807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9083fc22-26b6-4515-8698-40d240e81253 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:43.787491 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9083fc22-26b6-4515-8698-40d240e81253 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:43.787979 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9083fc22-26b6-4515-8698-40d240e81253 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:43.792615 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9083fc22-26b6-4515-8698-40d240e81253 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:43.793258 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9083fc22-26b6-4515-8698-40d240e81253 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:44.001892 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9083fc22-26b6-4515-8698-40d240e81253 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:44.012623 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9083fc22-26b6-4515-8698-40d240e81253 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.247960 May 25 16:08:44.014302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 73/142] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:43 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:44.131135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-d21f7da2-723a-4d46-ad34-fba45faf476d req-952a02ce-1ffd-4f74-8d1c-1b795bcb6106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb52261b-f0d9-4cfc-a5df-dc306324060a", "tag": "149c600b-b80f-41a1-a754-cb48b95c5cb2"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:44.140679 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-d21f7da2-723a-4d46-ad34-fba45faf476d req-952a02ce-1ffd-4f74-8d1c-1b795bcb6106 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:44.141121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-d21f7da2-723a-4d46-ad34-fba45faf476d req-952a02ce-1ffd-4f74-8d1c-1b795bcb6106 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:44.162593 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-d21f7da2-723a-4d46-ad34-fba45faf476d req-952a02ce-1ffd-4f74-8d1c-1b795bcb6106 service nova] Creating event network-changed:149c600b-b80f-41a1-a754-cb48b95c5cb2 for instance fb52261b-f0d9-4cfc-a5df-dc306324060a on hv-cinder-84327 May 25 16:08:44.172557 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-d21f7da2-723a-4d46-ad34-fba45faf476d req-952a02ce-1ffd-4f74-8d1c-1b795bcb6106 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048007 May 25 16:08:44.175200 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 70/143] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:44.708839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-cb7bb5a6-97aa-4152-830e-2007d1a1a8e3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:44.709494 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-cb7bb5a6-97aa-4152-830e-2007d1a1a8e3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:44.717479 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cb7bb5a6-97aa-4152-830e-2007d1a1a8e3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:44.718404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cb7bb5a6-97aa-4152-830e-2007d1a1a8e3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:44.720018 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cb7bb5a6-97aa-4152-830e-2007d1a1a8e3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:44.720666 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cb7bb5a6-97aa-4152-830e-2007d1a1a8e3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:44.905276 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-cb7bb5a6-97aa-4152-830e-2007d1a1a8e3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:44.923013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-cb7bb5a6-97aa-4152-830e-2007d1a1a8e3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.218064 May 25 16:08:44.923602 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 74/144] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:44 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:45.036565 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5a7dd1b4-b280-4a4a-a489-e59a3b46f4fc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:45.037803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5a7dd1b4-b280-4a4a-a489-e59a3b46f4fc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:45.045126 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a7dd1b4-b280-4a4a-a489-e59a3b46f4fc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:45.045591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a7dd1b4-b280-4a4a-a489-e59a3b46f4fc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:45.046549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a7dd1b4-b280-4a4a-a489-e59a3b46f4fc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:45.046978 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a7dd1b4-b280-4a4a-a489-e59a3b46f4fc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:45.218682 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5a7dd1b4-b280-4a4a-a489-e59a3b46f4fc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:45.226556 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5a7dd1b4-b280-4a4a-a489-e59a3b46f4fc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.199486 May 25 16:08:45.227140 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 71/145] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:45 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:45.940865 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b7965bf5-7670-48ef-947b-0a20626b3bcf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:45.942232 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b7965bf5-7670-48ef-947b-0a20626b3bcf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:45.950807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b7965bf5-7670-48ef-947b-0a20626b3bcf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:45.952031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b7965bf5-7670-48ef-947b-0a20626b3bcf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:45.954035 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b7965bf5-7670-48ef-947b-0a20626b3bcf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:45.955773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b7965bf5-7670-48ef-947b-0a20626b3bcf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:46.201074 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b7965bf5-7670-48ef-947b-0a20626b3bcf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:46.213110 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b7965bf5-7670-48ef-947b-0a20626b3bcf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.276872 May 25 16:08:46.213704 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 75/146] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:45 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:46.243957 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cccefda8-8e56-4e03-a606-541c6630f4e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:46.244763 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cccefda8-8e56-4e03-a606-541c6630f4e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:46.254603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cccefda8-8e56-4e03-a606-541c6630f4e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:46.256392 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cccefda8-8e56-4e03-a606-541c6630f4e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:46.257185 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cccefda8-8e56-4e03-a606-541c6630f4e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:46.257624 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cccefda8-8e56-4e03-a606-541c6630f4e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:46.671051 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cccefda8-8e56-4e03-a606-541c6630f4e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:46.685060 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cccefda8-8e56-4e03-a606-541c6630f4e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1363 microversion: 2.1 time: 0.445497 May 25 16:08:46.686026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 72/147] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:46 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:47.230104 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-cae987ed-b076-4a74-8e1b-27b44715ee90 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:47.231350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-cae987ed-b076-4a74-8e1b-27b44715ee90 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:47.238362 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cae987ed-b076-4a74-8e1b-27b44715ee90 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:47.239088 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cae987ed-b076-4a74-8e1b-27b44715ee90 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:47.240386 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cae987ed-b076-4a74-8e1b-27b44715ee90 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:47.241305 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cae987ed-b076-4a74-8e1b-27b44715ee90 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:47.526246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-cae987ed-b076-4a74-8e1b-27b44715ee90 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:47.542936 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-cae987ed-b076-4a74-8e1b-27b44715ee90 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.316736 May 25 16:08:47.544923 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 76/148] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:47 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:47.716333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-125b6f36-3e20-40e3-80f4-94c16bab7b20 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:47.717069 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-125b6f36-3e20-40e3-80f4-94c16bab7b20 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:47.728758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-125b6f36-3e20-40e3-80f4-94c16bab7b20 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:47.729074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-125b6f36-3e20-40e3-80f4-94c16bab7b20 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:47.730483 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-125b6f36-3e20-40e3-80f4-94c16bab7b20 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:47.731074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-125b6f36-3e20-40e3-80f4-94c16bab7b20 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:47.946804 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-125b6f36-3e20-40e3-80f4-94c16bab7b20 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:47.955668 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-125b6f36-3e20-40e3-80f4-94c16bab7b20 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1549 microversion: 2.1 time: 0.254601 May 25 16:08:47.957212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 73/149] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:47 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1549 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:47.979905 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c50542e6-c2c6-4648-8adb-ec386ca13350 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:47.980818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c50542e6-c2c6-4648-8adb-ec386ca13350 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:47.993404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c50542e6-c2c6-4648-8adb-ec386ca13350 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:47.994088 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c50542e6-c2c6-4648-8adb-ec386ca13350 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:47.996130 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c50542e6-c2c6-4648-8adb-ec386ca13350 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:47.996720 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c50542e6-c2c6-4648-8adb-ec386ca13350 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:48.132018 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c50542e6-c2c6-4648-8adb-ec386ca13350 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156332 May 25 16:08:48.132881 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 77/150] 10.222.0.85 () {58 vars in 1274 bytes} [Wed May 25 16:08:47 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:48.295721 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-44861ceb-773c-4829-974a-9ccbef8f9518 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:48.296757 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-44861ceb-773c-4829-974a-9ccbef8f9518 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:48.306105 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=100 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:48.312170 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-44861ceb-773c-4829-974a-9ccbef8f9518 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:48.312170 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-44861ceb-773c-4829-974a-9ccbef8f9518 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:48.316734 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-44861ceb-773c-4829-974a-9ccbef8f9518 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:48.316734 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-44861ceb-773c-4829-974a-9ccbef8f9518 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:48.379847 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-44861ceb-773c-4829-974a-9ccbef8f9518 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:08:48.540985 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-44861ceb-773c-4829-974a-9ccbef8f9518 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 204 len: 0 microversion: 2.1 time: 0.249198 May 25 16:08:48.548226 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 74/151] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:08:48 2022] DELETE /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:08:48.556389 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-980ec0f9-633f-4ea8-b87c-a54fb984a4e0 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:48.557626 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-980ec0f9-633f-4ea8-b87c-a54fb984a4e0 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:48.563038 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f358854f-2360-4f5d-9f5d-65fbb51305bb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:48.563948 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f358854f-2360-4f5d-9f5d-65fbb51305bb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:48.574151 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-980ec0f9-633f-4ea8-b87c-a54fb984a4e0 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:48.574852 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-980ec0f9-633f-4ea8-b87c-a54fb984a4e0 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:48.575800 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-980ec0f9-633f-4ea8-b87c-a54fb984a4e0 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:48.576871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-980ec0f9-633f-4ea8-b87c-a54fb984a4e0 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:48.578887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f358854f-2360-4f5d-9f5d-65fbb51305bb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:48.583523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f358854f-2360-4f5d-9f5d-65fbb51305bb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:48.583523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f358854f-2360-4f5d-9f5d-65fbb51305bb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:48.583523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f358854f-2360-4f5d-9f5d-65fbb51305bb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:48.583975 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:48.806219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f358854f-2360-4f5d-9f5d-65fbb51305bb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:48.819283 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f358854f-2360-4f5d-9f5d-65fbb51305bb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.261548 May 25 16:08:48.820477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 75/152] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:48 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:49.003403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-980ec0f9-633f-4ea8-b87c-a54fb984a4e0 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:49.017550 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-980ec0f9-633f-4ea8-b87c-a54fb984a4e0 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1553 microversion: 2.1 time: 0.465525 May 25 16:08:49.020948 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 78/153] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:48 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1553 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:49.836479 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-83042453-771c-4358-a316-3f0ba243c68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:49.837074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-83042453-771c-4358-a316-3f0ba243c68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:49.847159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83042453-771c-4358-a316-3f0ba243c68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:49.850026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83042453-771c-4358-a316-3f0ba243c68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:49.851080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83042453-771c-4358-a316-3f0ba243c68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:49.852702 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83042453-771c-4358-a316-3f0ba243c68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:50.036581 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-368d0a94-3f7c-462b-a516-db846522341c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:50.037234 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-368d0a94-3f7c-462b-a516-db846522341c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:50.045050 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-368d0a94-3f7c-462b-a516-db846522341c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:50.045737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-368d0a94-3f7c-462b-a516-db846522341c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:50.046678 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-368d0a94-3f7c-462b-a516-db846522341c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:50.047263 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-368d0a94-3f7c-462b-a516-db846522341c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:50.138382 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-83042453-771c-4358-a316-3f0ba243c68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:50.152529 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-83042453-771c-4358-a316-3f0ba243c68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.319206 May 25 16:08:50.162118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 76/154] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:49 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:50.261120 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-368d0a94-3f7c-462b-a516-db846522341c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:50.269494 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-0511acf8-5708-4d55-ba5c-5ba0122a73a8 req-6c84b437-2fce-4419-8702-b1e7a43ab6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c5f2914-854d-4d77-82e5-680200d4d6c8", "tag": "ba260aab-9e99-4e6c-ad1d-fdc814dca2d5"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:50.279327 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-0511acf8-5708-4d55-ba5c-5ba0122a73a8 req-6c84b437-2fce-4419-8702-b1e7a43ab6ef service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:50.280372 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-368d0a94-3f7c-462b-a516-db846522341c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1553 microversion: 2.1 time: 0.246892 May 25 16:08:50.280606 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-0511acf8-5708-4d55-ba5c-5ba0122a73a8 req-6c84b437-2fce-4419-8702-b1e7a43ab6ef service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:50.281424 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 79/155] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:50 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:50.293312 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-0511acf8-5708-4d55-ba5c-5ba0122a73a8 req-6c84b437-2fce-4419-8702-b1e7a43ab6ef service nova] Creating event network-changed:ba260aab-9e99-4e6c-ad1d-fdc814dca2d5 for instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 on hv-cinder-84327 May 25 16:08:50.303272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-0511acf8-5708-4d55-ba5c-5ba0122a73a8 req-6c84b437-2fce-4419-8702-b1e7a43ab6ef service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037379 May 25 16:08:50.304366 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 77/156] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:08:51.173044 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3d8700cd-1db9-4dc3-bd62-6e9453c8e022 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:51.174587 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3d8700cd-1db9-4dc3-bd62-6e9453c8e022 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:51.184567 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d8700cd-1db9-4dc3-bd62-6e9453c8e022 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:51.185250 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d8700cd-1db9-4dc3-bd62-6e9453c8e022 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:51.186750 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d8700cd-1db9-4dc3-bd62-6e9453c8e022 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:51.187412 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d8700cd-1db9-4dc3-bd62-6e9453c8e022 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:51.298421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0e495625-7152-4991-ba92-5a7fe2335457 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:51.301949 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0e495625-7152-4991-ba92-5a7fe2335457 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:51.316667 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e495625-7152-4991-ba92-5a7fe2335457 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:51.317222 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e495625-7152-4991-ba92-5a7fe2335457 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:51.317949 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e495625-7152-4991-ba92-5a7fe2335457 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:51.318412 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e495625-7152-4991-ba92-5a7fe2335457 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:51.656799 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3d8700cd-1db9-4dc3-bd62-6e9453c8e022 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:51.664958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3d8700cd-1db9-4dc3-bd62-6e9453c8e022 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.498047 May 25 16:08:51.673142 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 80/157] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:51 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:51.743501 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0e495625-7152-4991-ba92-5a7fe2335457 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:51.747769 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:51.759549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0e495625-7152-4991-ba92-5a7fe2335457 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1553 microversion: 2.1 time: 0.465303 May 25 16:08:51.762513 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 78/158] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:51 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1553 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:52.322567 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-750c548f-6d9b-430b-a434-6f9d02ec5a2f req-5a1189ce-bd5f-4f3b-ac1d-2a1d9db163ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6855067-d8ce-424f-b601-e0df21b52475", "name": "network-vif-deleted", "tag": "e7a62f3c-e0c8-466c-b12b-f52f98992106"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:08:52.343765 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-750c548f-6d9b-430b-a434-6f9d02ec5a2f req-5a1189ce-bd5f-4f3b-ac1d-2a1d9db163ba service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:52.346837 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-750c548f-6d9b-430b-a434-6f9d02ec5a2f req-5a1189ce-bd5f-4f3b-ac1d-2a1d9db163ba service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:52.375289 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-750c548f-6d9b-430b-a434-6f9d02ec5a2f req-5a1189ce-bd5f-4f3b-ac1d-2a1d9db163ba service nova] Creating event network-vif-deleted:e7a62f3c-e0c8-466c-b12b-f52f98992106 for instance b6855067-d8ce-424f-b601-e0df21b52475 on hv-cinder-84327 May 25 16:08:52.385869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-750c548f-6d9b-430b-a434-6f9d02ec5a2f req-5a1189ce-bd5f-4f3b-ac1d-2a1d9db163ba service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068708 May 25 16:08:52.386499 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 81/159] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:08:52.698128 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f2aebb01-04d5-4dd3-8e61-2fb40c37db4f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:52.700775 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f2aebb01-04d5-4dd3-8e61-2fb40c37db4f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:52.710401 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f2aebb01-04d5-4dd3-8e61-2fb40c37db4f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:52.710849 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f2aebb01-04d5-4dd3-8e61-2fb40c37db4f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:52.711947 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f2aebb01-04d5-4dd3-8e61-2fb40c37db4f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:52.712566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f2aebb01-04d5-4dd3-8e61-2fb40c37db4f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:52.777933 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-509e2ca5-b842-46bd-81d5-aa78339764fa tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:52.779062 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-509e2ca5-b842-46bd-81d5-aa78339764fa tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:52.785842 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-509e2ca5-b842-46bd-81d5-aa78339764fa tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:52.786573 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-509e2ca5-b842-46bd-81d5-aa78339764fa tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:52.787404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-509e2ca5-b842-46bd-81d5-aa78339764fa tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:52.787852 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-509e2ca5-b842-46bd-81d5-aa78339764fa tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:52.877524 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-509e2ca5-b842-46bd-81d5-aa78339764fa tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4d043b13da4b17830481f4a8da9b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6d103cb389478f94ce6afe687c0e28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:52.887069 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-509e2ca5-b842-46bd-81d5-aa78339764fa tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 200 len: 1346 microversion: 2.1 time: 0.113821 May 25 16:08:52.893458 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f2aebb01-04d5-4dd3-8e61-2fb40c37db4f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:52.897826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 82/160] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:52 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 1346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:08:52.903086 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f2aebb01-04d5-4dd3-8e61-2fb40c37db4f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.217115 May 25 16:08:52.904669 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 79/161] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:52 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:53.907526 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:53.908777 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:53.917570 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:53.918197 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:53.919131 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:53.919719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:53.923054 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cc911429-05af-4005-915f-4cf7d3f37fc6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:53.923664 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cc911429-05af-4005-915f-4cf7d3f37fc6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:53.930625 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cc911429-05af-4005-915f-4cf7d3f37fc6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:53.931080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cc911429-05af-4005-915f-4cf7d3f37fc6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:53.932331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cc911429-05af-4005-915f-4cf7d3f37fc6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:53.932779 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cc911429-05af-4005-915f-4cf7d3f37fc6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:53.937132 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] HTTP exception thrown: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Request method failure captured: May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 HTTP/1.1 May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRY1lgFOVMrWE3A7rcZLwVoZxWcCGymcJWhOL5FtEaPdZENQta7YdLnNetWHOPm-JtNzvTxyg3M7tjEg6H_V_fj5E-A-DszoMbw65mdYtiM6Z_Yb4lGv2Tj6fPl7mUTPF2veMyjLLny2AfE0dovWAEbqPkLHUlzqzP9BoSrpw7LsCU May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 1f6d103cb389478f94ce6afe687c0e28 May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:08:53.942352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1f6d103cb389478f94ce6afe687c0e28", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 1f6d103cb389478f94ce6afe687c0e28 May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-DeleteServersTestJSON-1069567480-project May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 1d4d043b13da4b17830481f4a8da9b79 May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-DeleteServersTestJSON-1069567480-project May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:53.943871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': 'b6855067-d8ce-424f-b601-e0df21b52475'} May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:08:53.944744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:53.945952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:53.949218 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Returning 404 to user: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:08:53.950262 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-43ccb860-d378-4587-93da-1e8e42b7d23c tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 404 len: 111 microversion: 2.1 time: 0.049897 May 25 16:08:53.950835 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 83/162] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:53 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:08:54.077669 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:54.079032 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:54.090180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:54.091028 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:54.092155 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:54.092731 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:54.114031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] HTTP exception thrown: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Request method failure captured: May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475/os-volume_attachments HTTP/1.1 May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRY1lgFOVMrWE3A7rcZLwVoZxWcCGymcJWhOL5FtEaPdZENQta7YdLnNetWHOPm-JtNzvTxyg3M7tjEg6H_V_fj5E-A-DszoMbw65mdYtiM6Z_Yb4lGv2Tj6fPl7mUTPF2veMyjLLny2AfE0dovWAEbqPkLHUlzqzP9BoSrpw7LsCU May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 1f6d103cb389478f94ce6afe687c0e28 May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:08:54.116377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1f6d103cb389478f94ce6afe687c0e28", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 1f6d103cb389478f94ce6afe687c0e28 May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-DeleteServersTestJSON-1069567480-project May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 1d4d043b13da4b17830481f4a8da9b79 May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-DeleteServersTestJSON-1069567480-project May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:54.117613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'server_id': 'b6855067-d8ce-424f-b601-e0df21b52475'} May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:08:54.118246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:54.119351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:54.121717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Returning 404 to user: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:08:54.122896 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-816a780b-676c-4ace-94bf-aedaf3640805 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050508 May 25 16:08:54.124043 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 84/163] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:08:54 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 16:08:54.163917 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cc911429-05af-4005-915f-4cf7d3f37fc6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:54.173549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cc911429-05af-4005-915f-4cf7d3f37fc6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.255033 May 25 16:08:54.174427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 80/164] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:53 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:55.193059 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-98d87aae-1a2e-4366-abac-7359ca5651f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:55.193789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-98d87aae-1a2e-4366-abac-7359ca5651f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:55.200454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-98d87aae-1a2e-4366-abac-7359ca5651f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:55.200893 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-98d87aae-1a2e-4366-abac-7359ca5651f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:55.201673 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-98d87aae-1a2e-4366-abac-7359ca5651f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:55.202096 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-98d87aae-1a2e-4366-abac-7359ca5651f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:55.344101 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-98d87aae-1a2e-4366-abac-7359ca5651f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:55.351981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-98d87aae-1a2e-4366-abac-7359ca5651f4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.162767 May 25 16:08:55.352432 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 85/165] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:55 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:55.408150 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:55.408703 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:55.415137 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:55.415576 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:55.416361 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:55.416799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:55.431551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] HTTP exception thrown: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Request method failure captured: May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: DELETE /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 HTTP/1.1 May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRY1lgFOVMrWE3A7rcZLwVoZxWcCGymcJWhOL5FtEaPdZENQta7YdLnNetWHOPm-JtNzvTxyg3M7tjEg6H_V_fj5E-A-DszoMbw65mdYtiM6Z_Yb4lGv2Tj6fPl7mUTPF2veMyjLLny2AfE0dovWAEbqPkLHUlzqzP9BoSrpw7LsCU May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 1f6d103cb389478f94ce6afe687c0e28 May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:08:55.436230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1f6d103cb389478f94ce6afe687c0e28", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 1f6d103cb389478f94ce6afe687c0e28 May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-DeleteServersTestJSON-1069567480-project May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 1d4d043b13da4b17830481f4a8da9b79 May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-DeleteServersTestJSON-1069567480-project May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.437467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'b6855067-d8ce-424f-b601-e0df21b52475'} May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:08:55.438109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.439272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:08:55.441369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Returning 404 to user: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:08:55.441369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-dbfef3ff-d62e-47af-8a39-5d3289c03e43 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 404 len: 111 microversion: 2.1 time: 0.033406 May 25 16:08:55.441369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 81/166] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:08:55 2022] DELETE /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:08:55.448632 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:55.449307 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] [instance: b6855067-d8ce-424f-b601-e0df21b52475] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:55.455651 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:55.456128 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:55.456877 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:55.457303 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:55.476899 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] HTTP exception thrown: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Request method failure captured: May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 HTTP/1.1 May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRY1lgFOVMrWE3A7rcZLwVoZxWcCGymcJWhOL5FtEaPdZENQta7YdLnNetWHOPm-JtNzvTxyg3M7tjEg6H_V_fj5E-A-DszoMbw65mdYtiM6Z_Yb4lGv2Tj6fPl7mUTPF2veMyjLLny2AfE0dovWAEbqPkLHUlzqzP9BoSrpw7LsCU May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 1f6d103cb389478f94ce6afe687c0e28 May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:08:55.479061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_1f6d103cb389478f94ce6afe687c0e28", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/1f6d103cb389478f94ce6afe687c0e28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 1f6d103cb389478f94ce6afe687c0e28 May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-DeleteServersTestJSON-1069567480 May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-DeleteServersTestJSON-1069567480-project May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 1d4d043b13da4b17830481f4a8da9b79 May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-DeleteServersTestJSON-1069567480-project May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.480586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': 'b6855067-d8ce-424f-b601-e0df21b52475'} May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:08:55.481361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. May 25 16:08:55.482792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:08:55.483988 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] Returning 404 to user: Instance b6855067-d8ce-424f-b601-e0df21b52475 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:08:55.483988 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8dbefc12-160a-4a22-a8c4-efd81f43dc83 tempest-DeleteServersTestJSON-1069567480 tempest-DeleteServersTestJSON-1069567480-project] 10.222.0.85 "GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475" status: 404 len: 111 microversion: 2.1 time: 0.036976 May 25 16:08:55.483988 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 86/167] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:55 2022] GET /compute/v2.1/servers/b6855067-d8ce-424f-b601-e0df21b52475 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 16:08:56.369108 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-24b9e5de-20ce-4e4d-ac55-e8deffe321c3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:56.369819 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-24b9e5de-20ce-4e4d-ac55-e8deffe321c3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:56.376479 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-24b9e5de-20ce-4e4d-ac55-e8deffe321c3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:56.376916 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-24b9e5de-20ce-4e4d-ac55-e8deffe321c3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:56.377997 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-24b9e5de-20ce-4e4d-ac55-e8deffe321c3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:56.378559 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-24b9e5de-20ce-4e4d-ac55-e8deffe321c3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:56.560367 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-24b9e5de-20ce-4e4d-ac55-e8deffe321c3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:56.568829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-24b9e5de-20ce-4e4d-ac55-e8deffe321c3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.203761 May 25 16:08:56.569557 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 82/168] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:56 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:57.587203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-51a31a89-d74b-4ae8-9877-affd7012a762 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:57.588008 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-51a31a89-d74b-4ae8-9877-affd7012a762 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:57.594931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-51a31a89-d74b-4ae8-9877-affd7012a762 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:57.595375 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-51a31a89-d74b-4ae8-9877-affd7012a762 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:57.596215 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-51a31a89-d74b-4ae8-9877-affd7012a762 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:57.596644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-51a31a89-d74b-4ae8-9877-affd7012a762 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:57.749481 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-51a31a89-d74b-4ae8-9877-affd7012a762 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:57.762159 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-51a31a89-d74b-4ae8-9877-affd7012a762 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.179700 May 25 16:08:57.763186 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 87/169] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:57 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:58.778867 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5a4d6132-20cd-44aa-839f-4243a86889bc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:58.779469 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5a4d6132-20cd-44aa-839f-4243a86889bc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:58.785520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a4d6132-20cd-44aa-839f-4243a86889bc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:58.785975 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a4d6132-20cd-44aa-839f-4243a86889bc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:58.786776 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a4d6132-20cd-44aa-839f-4243a86889bc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:58.787204 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a4d6132-20cd-44aa-839f-4243a86889bc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:58.917578 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5a4d6132-20cd-44aa-839f-4243a86889bc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:08:58.925592 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5a4d6132-20cd-44aa-839f-4243a86889bc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.151098 May 25 16:08:58.926169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 83/170] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:58 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:08:59.943037 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-138e7aa4-48cb-4d74-ba6e-cbc549d18111 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:08:59.943659 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-138e7aa4-48cb-4d74-ba6e-cbc549d18111 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:08:59.950579 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-138e7aa4-48cb-4d74-ba6e-cbc549d18111 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:59.951064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-138e7aa4-48cb-4d74-ba6e-cbc549d18111 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:08:59.951796 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-138e7aa4-48cb-4d74-ba6e-cbc549d18111 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:08:59.952265 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-138e7aa4-48cb-4d74-ba6e-cbc549d18111 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:00.105922 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-138e7aa4-48cb-4d74-ba6e-cbc549d18111 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:00.116402 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-138e7aa4-48cb-4d74-ba6e-cbc549d18111 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.177458 May 25 16:09:00.117681 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 88/171] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:08:59 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:01.134275 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-069c3202-2497-4e63-ae9a-f4a75547fde9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:01.136640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-069c3202-2497-4e63-ae9a-f4a75547fde9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:01.143271 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-069c3202-2497-4e63-ae9a-f4a75547fde9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:01.143883 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-069c3202-2497-4e63-ae9a-f4a75547fde9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:01.144665 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-069c3202-2497-4e63-ae9a-f4a75547fde9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:01.145137 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-069c3202-2497-4e63-ae9a-f4a75547fde9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:01.285205 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-069c3202-2497-4e63-ae9a-f4a75547fde9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:01.293513 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-069c3202-2497-4e63-ae9a-f4a75547fde9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.163642 May 25 16:09:01.294077 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 84/172] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:01 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:02.314766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a5b6139e-913c-45ae-bbb6-7e5d2c7ac42b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:02.316404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a5b6139e-913c-45ae-bbb6-7e5d2c7ac42b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:02.324723 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a5b6139e-913c-45ae-bbb6-7e5d2c7ac42b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:02.325183 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a5b6139e-913c-45ae-bbb6-7e5d2c7ac42b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:02.325967 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a5b6139e-913c-45ae-bbb6-7e5d2c7ac42b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:02.326401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a5b6139e-913c-45ae-bbb6-7e5d2c7ac42b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:02.467740 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a5b6139e-913c-45ae-bbb6-7e5d2c7ac42b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:02.476350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a5b6139e-913c-45ae-bbb6-7e5d2c7ac42b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.168261 May 25 16:09:02.477146 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 89/173] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:02 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:03.499812 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9a754915-af87-46a5-bcc0-47eb2a2f4179 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:03.500653 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9a754915-af87-46a5-bcc0-47eb2a2f4179 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:03.508887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9a754915-af87-46a5-bcc0-47eb2a2f4179 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:03.509442 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9a754915-af87-46a5-bcc0-47eb2a2f4179 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:03.512504 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9a754915-af87-46a5-bcc0-47eb2a2f4179 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:03.513170 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9a754915-af87-46a5-bcc0-47eb2a2f4179 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:03.652805 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9a754915-af87-46a5-bcc0-47eb2a2f4179 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:03.662315 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9a754915-af87-46a5-bcc0-47eb2a2f4179 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.167183 May 25 16:09:03.662910 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 85/174] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:03 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:04.679187 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f3466d7a-1619-49ac-bc5a-7c0213e0571d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:04.679968 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f3466d7a-1619-49ac-bc5a-7c0213e0571d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:04.687707 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f3466d7a-1619-49ac-bc5a-7c0213e0571d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:04.688226 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f3466d7a-1619-49ac-bc5a-7c0213e0571d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:04.689020 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f3466d7a-1619-49ac-bc5a-7c0213e0571d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:04.689456 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f3466d7a-1619-49ac-bc5a-7c0213e0571d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:04.830246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f3466d7a-1619-49ac-bc5a-7c0213e0571d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:04.838962 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f3466d7a-1619-49ac-bc5a-7c0213e0571d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.163504 May 25 16:09:04.839854 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 90/175] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:04 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:05.856509 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-317a3a26-8d3d-40cf-8865-ab37f5d26e73 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:05.857053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-317a3a26-8d3d-40cf-8865-ab37f5d26e73 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:05.863753 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-317a3a26-8d3d-40cf-8865-ab37f5d26e73 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:05.864254 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-317a3a26-8d3d-40cf-8865-ab37f5d26e73 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:05.865051 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-317a3a26-8d3d-40cf-8865-ab37f5d26e73 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:05.865500 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-317a3a26-8d3d-40cf-8865-ab37f5d26e73 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:05.997712 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-317a3a26-8d3d-40cf-8865-ab37f5d26e73 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:06.005918 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-317a3a26-8d3d-40cf-8865-ab37f5d26e73 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.153412 May 25 16:09:06.006758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 86/176] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:05 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:07.024130 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6c699b04-c26a-41c3-a357-23be58ccdb6c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:07.024747 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-6c699b04-c26a-41c3-a357-23be58ccdb6c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:07.031559 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6c699b04-c26a-41c3-a357-23be58ccdb6c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:07.032168 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6c699b04-c26a-41c3-a357-23be58ccdb6c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:07.033126 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6c699b04-c26a-41c3-a357-23be58ccdb6c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:07.033644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6c699b04-c26a-41c3-a357-23be58ccdb6c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:07.170394 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-6c699b04-c26a-41c3-a357-23be58ccdb6c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:07.178257 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6c699b04-c26a-41c3-a357-23be58ccdb6c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.158859 May 25 16:09:07.178836 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 91/177] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:07 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:08.198467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-386f86a3-d1af-4d2a-90cb-bead5cb56d52 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:08.198996 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-386f86a3-d1af-4d2a-90cb-bead5cb56d52 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:08.207898 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-386f86a3-d1af-4d2a-90cb-bead5cb56d52 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:08.208516 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-386f86a3-d1af-4d2a-90cb-bead5cb56d52 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:08.209555 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-386f86a3-d1af-4d2a-90cb-bead5cb56d52 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:08.210111 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-386f86a3-d1af-4d2a-90cb-bead5cb56d52 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:08.360109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-386f86a3-d1af-4d2a-90cb-bead5cb56d52 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:08.368167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-386f86a3-d1af-4d2a-90cb-bead5cb56d52 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.175374 May 25 16:09:08.368777 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 87/178] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:08 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:09.385458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f8e2f0f5-bf68-4eaa-a115-b9133a4d5dd1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:09.386075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f8e2f0f5-bf68-4eaa-a115-b9133a4d5dd1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:09.393556 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f8e2f0f5-bf68-4eaa-a115-b9133a4d5dd1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:09.394008 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f8e2f0f5-bf68-4eaa-a115-b9133a4d5dd1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:09.394772 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f8e2f0f5-bf68-4eaa-a115-b9133a4d5dd1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:09.395208 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f8e2f0f5-bf68-4eaa-a115-b9133a4d5dd1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:09.538347 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f8e2f0f5-bf68-4eaa-a115-b9133a4d5dd1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:09.546329 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f8e2f0f5-bf68-4eaa-a115-b9133a4d5dd1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.164987 May 25 16:09:09.546922 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 92/179] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:09 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:10.563557 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0d1a92a0-ff85-4145-b817-20f1130c3106 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:10.564194 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0d1a92a0-ff85-4145-b817-20f1130c3106 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:10.570832 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0d1a92a0-ff85-4145-b817-20f1130c3106 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:10.571274 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0d1a92a0-ff85-4145-b817-20f1130c3106 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:10.572070 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0d1a92a0-ff85-4145-b817-20f1130c3106 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:10.572498 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0d1a92a0-ff85-4145-b817-20f1130c3106 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:10.712645 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0d1a92a0-ff85-4145-b817-20f1130c3106 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:10.720438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0d1a92a0-ff85-4145-b817-20f1130c3106 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.160770 May 25 16:09:10.721009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 88/180] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:10 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:11.737684 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-215b50d9-2dba-470e-9f25-c9e11c4e33f0 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:11.738311 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-215b50d9-2dba-470e-9f25-c9e11c4e33f0 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:11.740883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=52 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:11.747464 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-215b50d9-2dba-470e-9f25-c9e11c4e33f0 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:11.747946 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-215b50d9-2dba-470e-9f25-c9e11c4e33f0 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:11.748727 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-215b50d9-2dba-470e-9f25-c9e11c4e33f0 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:11.749215 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-215b50d9-2dba-470e-9f25-c9e11c4e33f0 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:11.884239 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-215b50d9-2dba-470e-9f25-c9e11c4e33f0 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:11.891978 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-215b50d9-2dba-470e-9f25-c9e11c4e33f0 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.158152 May 25 16:09:11.892545 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 93/181] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:11 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:12.909308 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cfe9210c-5446-4fc0-b57f-72ceea518b02 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:12.909942 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cfe9210c-5446-4fc0-b57f-72ceea518b02 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:12.916780 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfe9210c-5446-4fc0-b57f-72ceea518b02 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:12.917215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfe9210c-5446-4fc0-b57f-72ceea518b02 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:12.918195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfe9210c-5446-4fc0-b57f-72ceea518b02 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:12.918618 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfe9210c-5446-4fc0-b57f-72ceea518b02 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:13.053814 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cfe9210c-5446-4fc0-b57f-72ceea518b02 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:13.061644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cfe9210c-5446-4fc0-b57f-72ceea518b02 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.156383 May 25 16:09:13.062194 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 89/182] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:12 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:14.078810 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-db517483-69bc-4744-9c35-d3cfe0a5531a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:14.079388 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-db517483-69bc-4744-9c35-d3cfe0a5531a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:14.086230 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-db517483-69bc-4744-9c35-d3cfe0a5531a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:14.086673 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-db517483-69bc-4744-9c35-d3cfe0a5531a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:14.087552 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-db517483-69bc-4744-9c35-d3cfe0a5531a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:14.087944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-db517483-69bc-4744-9c35-d3cfe0a5531a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:14.284259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-db517483-69bc-4744-9c35-d3cfe0a5531a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:14.293670 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-db517483-69bc-4744-9c35-d3cfe0a5531a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.218586 May 25 16:09:14.295076 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 94/183] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:14 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:15.311549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-358dc5c8-078b-4db5-9098-d2aa1a80a6bd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:15.312840 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-358dc5c8-078b-4db5-9098-d2aa1a80a6bd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:15.319614 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-358dc5c8-078b-4db5-9098-d2aa1a80a6bd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:15.320245 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-358dc5c8-078b-4db5-9098-d2aa1a80a6bd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:15.321083 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-358dc5c8-078b-4db5-9098-d2aa1a80a6bd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:15.321779 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-358dc5c8-078b-4db5-9098-d2aa1a80a6bd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:15.469410 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-358dc5c8-078b-4db5-9098-d2aa1a80a6bd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:15.477278 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-358dc5c8-078b-4db5-9098-d2aa1a80a6bd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.169913 May 25 16:09:15.478409 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 90/184] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:15 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:16.494577 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f9affb41-7beb-49e2-9809-8a05b147e945 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:16.495154 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f9affb41-7beb-49e2-9809-8a05b147e945 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:16.502221 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f9affb41-7beb-49e2-9809-8a05b147e945 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:16.502666 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f9affb41-7beb-49e2-9809-8a05b147e945 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:16.503471 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f9affb41-7beb-49e2-9809-8a05b147e945 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:16.503934 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f9affb41-7beb-49e2-9809-8a05b147e945 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:16.642978 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f9affb41-7beb-49e2-9809-8a05b147e945 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:16.650796 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f9affb41-7beb-49e2-9809-8a05b147e945 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1523 microversion: 2.1 time: 0.160255 May 25 16:09:16.651717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 95/185] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:16 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:17.668974 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-286a82b6-4457-4eb0-9ba2-cd9d83ddd434 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:17.669597 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-286a82b6-4457-4eb0-9ba2-cd9d83ddd434 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:17.676357 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-286a82b6-4457-4eb0-9ba2-cd9d83ddd434 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:17.676812 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-286a82b6-4457-4eb0-9ba2-cd9d83ddd434 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:17.677638 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-286a82b6-4457-4eb0-9ba2-cd9d83ddd434 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:17.678077 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-286a82b6-4457-4eb0-9ba2-cd9d83ddd434 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:17.809401 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-286a82b6-4457-4eb0-9ba2-cd9d83ddd434 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:17.817431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-286a82b6-4457-4eb0-9ba2-cd9d83ddd434 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1503 microversion: 2.1 time: 0.152954 May 25 16:09:17.817923 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 91/186] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:17 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:17.833744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-876f95f5-1ae4-4306-824d-bb846eddd15f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:17.834372 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-876f95f5-1ae4-4306-824d-bb846eddd15f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:17.840616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-876f95f5-1ae4-4306-824d-bb846eddd15f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:17.841054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-876f95f5-1ae4-4306-824d-bb846eddd15f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:17.841802 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-876f95f5-1ae4-4306-824d-bb846eddd15f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:17.842242 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-876f95f5-1ae4-4306-824d-bb846eddd15f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:17.977848 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-876f95f5-1ae4-4306-824d-bb846eddd15f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:17.986297 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-876f95f5-1ae4-4306-824d-bb846eddd15f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1517 microversion: 2.1 time: 0.156337 May 25 16:09:17.987667 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 96/187] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:17 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:09:19.360840 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4a2fab6d-d27a-4484-b1a7-31edb3534416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:19.361842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4a2fab6d-d27a-4484-b1a7-31edb3534416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:19.363758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:19.369134 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4a2fab6d-d27a-4484-b1a7-31edb3534416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:19.369580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4a2fab6d-d27a-4484-b1a7-31edb3534416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:19.370339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4a2fab6d-d27a-4484-b1a7-31edb3534416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:19.370793 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4a2fab6d-d27a-4484-b1a7-31edb3534416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:19.394671 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-4a2fab6d-d27a-4484-b1a7-31edb3534416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lazy-loading 'flavor' on Instance uuid 8f650730-0534-4f4b-92b9-6d6be8cc54c7 {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:09:19.506647 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4a2fab6d-d27a-4484-b1a7-31edb3534416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7/action" status: 200 len: 32 microversion: 2.1 time: 0.149751 May 25 16:09:19.507436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 92/188] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:09:19 2022] POST /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7/action => generated 32 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:09:19.517377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a52b821e-6339-41b7-9335-15e9846038c8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:19.518017 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a52b821e-6339-41b7-9335-15e9846038c8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:19.524754 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a52b821e-6339-41b7-9335-15e9846038c8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:19.525372 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a52b821e-6339-41b7-9335-15e9846038c8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:19.526693 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a52b821e-6339-41b7-9335-15e9846038c8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:19.527167 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a52b821e-6339-41b7-9335-15e9846038c8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:19.530250 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=97 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:19.725570 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a52b821e-6339-41b7-9335-15e9846038c8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:19.735431 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a52b821e-6339-41b7-9335-15e9846038c8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.222696 May 25 16:09:19.736049 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 97/189] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:19 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:20.753985 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a1a38c3f-3711-4336-affb-193e5bbdf5d6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:20.754757 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a1a38c3f-3711-4336-affb-193e5bbdf5d6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:20.761817 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a1a38c3f-3711-4336-affb-193e5bbdf5d6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:20.762358 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a1a38c3f-3711-4336-affb-193e5bbdf5d6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:20.763259 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a1a38c3f-3711-4336-affb-193e5bbdf5d6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:20.763749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a1a38c3f-3711-4336-affb-193e5bbdf5d6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:20.975676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a1a38c3f-3711-4336-affb-193e5bbdf5d6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:20.983433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a1a38c3f-3711-4336-affb-193e5bbdf5d6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.233974 May 25 16:09:20.984130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 93/190] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:20 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:22.000507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-efd7ab7f-c669-4861-8cae-b2c487f92ee3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:22.001307 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-efd7ab7f-c669-4861-8cae-b2c487f92ee3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:22.008306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-efd7ab7f-c669-4861-8cae-b2c487f92ee3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:22.008863 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-efd7ab7f-c669-4861-8cae-b2c487f92ee3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:22.009695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-efd7ab7f-c669-4861-8cae-b2c487f92ee3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:22.010198 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-efd7ab7f-c669-4861-8cae-b2c487f92ee3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:22.145691 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-efd7ab7f-c669-4861-8cae-b2c487f92ee3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:22.153623 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-efd7ab7f-c669-4861-8cae-b2c487f92ee3 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.156977 May 25 16:09:22.155514 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 98/191] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:21 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:23.170896 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-55a88e16-242c-4994-95a5-8005ca506169 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:23.171475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-55a88e16-242c-4994-95a5-8005ca506169 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:23.177883 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-55a88e16-242c-4994-95a5-8005ca506169 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:23.178309 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-55a88e16-242c-4994-95a5-8005ca506169 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:23.179092 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-55a88e16-242c-4994-95a5-8005ca506169 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:23.179527 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-55a88e16-242c-4994-95a5-8005ca506169 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:23.182228 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:23.317421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-55a88e16-242c-4994-95a5-8005ca506169 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:23.328721 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-55a88e16-242c-4994-95a5-8005ca506169 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.161498 May 25 16:09:23.329544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 94/192] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:23 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:24.350771 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-192adb06-814f-4d39-a62f-a69f9936b4c9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:24.351418 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-192adb06-814f-4d39-a62f-a69f9936b4c9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:24.358332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-192adb06-814f-4d39-a62f-a69f9936b4c9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:24.358786 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-192adb06-814f-4d39-a62f-a69f9936b4c9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:24.359552 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-192adb06-814f-4d39-a62f-a69f9936b4c9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:24.360023 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-192adb06-814f-4d39-a62f-a69f9936b4c9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:24.487303 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-192adb06-814f-4d39-a62f-a69f9936b4c9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:24.495316 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-192adb06-814f-4d39-a62f-a69f9936b4c9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.148417 May 25 16:09:24.495907 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 99/193] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:24 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:25.512359 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e459d88a-37ef-4fc7-908c-81ff20be20fe tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:25.513026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e459d88a-37ef-4fc7-908c-81ff20be20fe tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:25.519026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e459d88a-37ef-4fc7-908c-81ff20be20fe tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:25.519477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e459d88a-37ef-4fc7-908c-81ff20be20fe tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:25.520276 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e459d88a-37ef-4fc7-908c-81ff20be20fe tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:25.520709 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e459d88a-37ef-4fc7-908c-81ff20be20fe tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:25.655128 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e459d88a-37ef-4fc7-908c-81ff20be20fe tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:25.666242 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e459d88a-37ef-4fc7-908c-81ff20be20fe tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.157682 May 25 16:09:25.666809 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 95/194] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:25 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:26.683226 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b5e30d7d-4cd2-4602-b283-c703828aa86e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:26.683871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b5e30d7d-4cd2-4602-b283-c703828aa86e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:26.691072 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b5e30d7d-4cd2-4602-b283-c703828aa86e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:26.691519 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b5e30d7d-4cd2-4602-b283-c703828aa86e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:26.692323 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b5e30d7d-4cd2-4602-b283-c703828aa86e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:26.692741 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b5e30d7d-4cd2-4602-b283-c703828aa86e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:26.836439 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b5e30d7d-4cd2-4602-b283-c703828aa86e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:26.844724 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b5e30d7d-4cd2-4602-b283-c703828aa86e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.166112 May 25 16:09:26.845468 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 100/195] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:26 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:27.862047 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b45aa4ba-c7a3-4824-a95c-4526bf0bc191 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:27.862993 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b45aa4ba-c7a3-4824-a95c-4526bf0bc191 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:27.871996 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b45aa4ba-c7a3-4824-a95c-4526bf0bc191 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:27.872632 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b45aa4ba-c7a3-4824-a95c-4526bf0bc191 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:27.873384 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b45aa4ba-c7a3-4824-a95c-4526bf0bc191 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:27.873806 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b45aa4ba-c7a3-4824-a95c-4526bf0bc191 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:28.007097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b45aa4ba-c7a3-4824-a95c-4526bf0bc191 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:28.014908 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b45aa4ba-c7a3-4824-a95c-4526bf0bc191 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.156652 May 25 16:09:28.015536 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 96/196] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:27 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:29.033592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c753e341-6c2f-417a-975b-1d09c8208b6d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:29.034273 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c753e341-6c2f-417a-975b-1d09c8208b6d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:29.041045 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c753e341-6c2f-417a-975b-1d09c8208b6d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:29.041484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c753e341-6c2f-417a-975b-1d09c8208b6d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:29.042279 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c753e341-6c2f-417a-975b-1d09c8208b6d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:29.042726 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c753e341-6c2f-417a-975b-1d09c8208b6d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:29.175590 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c753e341-6c2f-417a-975b-1d09c8208b6d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:29.183419 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c753e341-6c2f-417a-975b-1d09c8208b6d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.154529 May 25 16:09:29.183988 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 101/197] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:29 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:30.201007 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-32028cab-0657-4b32-97b9-dde94ab44c87 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:30.201616 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-32028cab-0657-4b32-97b9-dde94ab44c87 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:30.208195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-32028cab-0657-4b32-97b9-dde94ab44c87 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:30.208644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-32028cab-0657-4b32-97b9-dde94ab44c87 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:30.209412 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-32028cab-0657-4b32-97b9-dde94ab44c87 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:30.209847 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-32028cab-0657-4b32-97b9-dde94ab44c87 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:30.336701 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-32028cab-0657-4b32-97b9-dde94ab44c87 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:30.344642 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-32028cab-0657-4b32-97b9-dde94ab44c87 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.147650 May 25 16:09:30.345220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 97/198] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:30 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:31.361781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e0fe9f58-d619-4355-bc8e-250955f5cd5f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:31.362389 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e0fe9f58-d619-4355-bc8e-250955f5cd5f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:31.369430 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0fe9f58-d619-4355-bc8e-250955f5cd5f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:31.369870 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0fe9f58-d619-4355-bc8e-250955f5cd5f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:31.370625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0fe9f58-d619-4355-bc8e-250955f5cd5f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:31.371053 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0fe9f58-d619-4355-bc8e-250955f5cd5f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:31.504159 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e0fe9f58-d619-4355-bc8e-250955f5cd5f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:31.511784 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e0fe9f58-d619-4355-bc8e-250955f5cd5f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.153828 May 25 16:09:31.512375 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 102/199] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:31 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:32.533189 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2f64d603-4fea-427a-aeda-b26dfcbd30cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:32.534158 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2f64d603-4fea-427a-aeda-b26dfcbd30cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:32.542914 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f64d603-4fea-427a-aeda-b26dfcbd30cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:32.543365 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f64d603-4fea-427a-aeda-b26dfcbd30cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:32.544167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f64d603-4fea-427a-aeda-b26dfcbd30cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:32.544604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f64d603-4fea-427a-aeda-b26dfcbd30cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:32.672417 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2f64d603-4fea-427a-aeda-b26dfcbd30cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:32.680264 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2f64d603-4fea-427a-aeda-b26dfcbd30cf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.153573 May 25 16:09:32.680893 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 98/200] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:32 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:33.703903 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1b574bea-1931-448a-9c8e-f0c92ebfbd19 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:33.704983 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1b574bea-1931-448a-9c8e-f0c92ebfbd19 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:33.716086 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1b574bea-1931-448a-9c8e-f0c92ebfbd19 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:33.716841 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1b574bea-1931-448a-9c8e-f0c92ebfbd19 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:33.718100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1b574bea-1931-448a-9c8e-f0c92ebfbd19 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:33.718826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1b574bea-1931-448a-9c8e-f0c92ebfbd19 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:33.859088 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1b574bea-1931-448a-9c8e-f0c92ebfbd19 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:33.867180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1b574bea-1931-448a-9c8e-f0c92ebfbd19 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.169762 May 25 16:09:33.867750 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 103/201] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:33 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:34.888304 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5722d2fd-f1c2-4e10-853d-881a1461ddf4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:34.889299 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5722d2fd-f1c2-4e10-853d-881a1461ddf4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:34.899640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5722d2fd-f1c2-4e10-853d-881a1461ddf4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:34.900502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5722d2fd-f1c2-4e10-853d-881a1461ddf4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:34.901367 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5722d2fd-f1c2-4e10-853d-881a1461ddf4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:34.902107 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5722d2fd-f1c2-4e10-853d-881a1461ddf4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:35.262219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5722d2fd-f1c2-4e10-853d-881a1461ddf4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:35.269946 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5722d2fd-f1c2-4e10-853d-881a1461ddf4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.388174 May 25 16:09:35.270516 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 99/202] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:34 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:36.289359 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-064e2ab2-623b-4dc1-aba1-764303f12bb7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:36.290330 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-064e2ab2-623b-4dc1-aba1-764303f12bb7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:36.297021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-064e2ab2-623b-4dc1-aba1-764303f12bb7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:36.297498 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-064e2ab2-623b-4dc1-aba1-764303f12bb7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:36.298267 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-064e2ab2-623b-4dc1-aba1-764303f12bb7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:36.298733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-064e2ab2-623b-4dc1-aba1-764303f12bb7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:36.428518 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-064e2ab2-623b-4dc1-aba1-764303f12bb7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:36.436441 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-064e2ab2-623b-4dc1-aba1-764303f12bb7 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.152457 May 25 16:09:36.437033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 104/203] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:36 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:37.454050 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c4cfae4c-07d9-4653-bf36-dbe237de48bf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:37.454613 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c4cfae4c-07d9-4653-bf36-dbe237de48bf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:37.461064 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c4cfae4c-07d9-4653-bf36-dbe237de48bf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:37.461504 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c4cfae4c-07d9-4653-bf36-dbe237de48bf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:37.462258 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c4cfae4c-07d9-4653-bf36-dbe237de48bf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:37.462683 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c4cfae4c-07d9-4653-bf36-dbe237de48bf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:37.593934 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c4cfae4c-07d9-4653-bf36-dbe237de48bf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:37.602112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c4cfae4c-07d9-4653-bf36-dbe237de48bf tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.152036 May 25 16:09:37.603372 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 100/204] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:37 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:38.620019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a90fae22-5863-4c67-a0ce-d53e3f96ff83 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:38.620630 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a90fae22-5863-4c67-a0ce-d53e3f96ff83 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:38.627414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a90fae22-5863-4c67-a0ce-d53e3f96ff83 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:38.627857 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a90fae22-5863-4c67-a0ce-d53e3f96ff83 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:38.628667 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a90fae22-5863-4c67-a0ce-d53e3f96ff83 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:38.629101 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a90fae22-5863-4c67-a0ce-d53e3f96ff83 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:38.764754 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a90fae22-5863-4c67-a0ce-d53e3f96ff83 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:38.772417 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a90fae22-5863-4c67-a0ce-d53e3f96ff83 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.156501 May 25 16:09:38.773103 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 105/205] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:38 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:39.790030 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c69a6f37-aa27-4712-85b9-0cc4cadc39b4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:39.790605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c69a6f37-aa27-4712-85b9-0cc4cadc39b4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:39.797442 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c69a6f37-aa27-4712-85b9-0cc4cadc39b4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:39.797888 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c69a6f37-aa27-4712-85b9-0cc4cadc39b4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:39.798676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c69a6f37-aa27-4712-85b9-0cc4cadc39b4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:39.799300 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c69a6f37-aa27-4712-85b9-0cc4cadc39b4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:39.930665 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c69a6f37-aa27-4712-85b9-0cc4cadc39b4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:39.938091 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c69a6f37-aa27-4712-85b9-0cc4cadc39b4 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.152148 May 25 16:09:39.938660 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 101/206] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:39 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:40.956040 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e13e197e-5ac6-42d3-8aec-8707215fdb8a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:40.956656 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e13e197e-5ac6-42d3-8aec-8707215fdb8a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:40.963553 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e13e197e-5ac6-42d3-8aec-8707215fdb8a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:40.964074 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e13e197e-5ac6-42d3-8aec-8707215fdb8a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:40.964894 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e13e197e-5ac6-42d3-8aec-8707215fdb8a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:40.965340 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e13e197e-5ac6-42d3-8aec-8707215fdb8a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:41.200331 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e13e197e-5ac6-42d3-8aec-8707215fdb8a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:41.211977 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e13e197e-5ac6-42d3-8aec-8707215fdb8a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.261384 May 25 16:09:41.221742 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 106/207] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:40 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:42.230273 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-477ff072-c9e1-4bbd-8655-48d6b639fb64 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:42.230898 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-477ff072-c9e1-4bbd-8655-48d6b639fb64 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:42.241049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-477ff072-c9e1-4bbd-8655-48d6b639fb64 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:42.243846 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-477ff072-c9e1-4bbd-8655-48d6b639fb64 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:42.246074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-477ff072-c9e1-4bbd-8655-48d6b639fb64 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:42.247337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-477ff072-c9e1-4bbd-8655-48d6b639fb64 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:42.443284 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-477ff072-c9e1-4bbd-8655-48d6b639fb64 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:42.454943 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-477ff072-c9e1-4bbd-8655-48d6b639fb64 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.229449 May 25 16:09:42.456339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 102/208] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:42 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:43.471985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2fd3a26e-11ab-4c39-a901-2bb7caaa9bca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:43.472591 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2fd3a26e-11ab-4c39-a901-2bb7caaa9bca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:43.475497 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=28 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:43.481296 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2fd3a26e-11ab-4c39-a901-2bb7caaa9bca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:43.481741 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2fd3a26e-11ab-4c39-a901-2bb7caaa9bca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:43.482557 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2fd3a26e-11ab-4c39-a901-2bb7caaa9bca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:43.482986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2fd3a26e-11ab-4c39-a901-2bb7caaa9bca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:43.613312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2fd3a26e-11ab-4c39-a901-2bb7caaa9bca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:43.620927 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2fd3a26e-11ab-4c39-a901-2bb7caaa9bca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1503 microversion: 2.1 time: 0.152898 May 25 16:09:43.621496 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 107/209] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:43 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:43.637378 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce9befc-c695-477f-b3a3-ae7db309a230"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:43.638468 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:43.645005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:43.645448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:43.646222 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:43.646638 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:43.673839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] HTTP exception thrown: Cannot 'attach_volume' instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 while it is in vm_state rescued May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Request method failure captured: May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: POST /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7/os-volume_attachments HTTP/1.1 May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 74 May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRflM6mHDm1IBYk5QaFi8bNjnvFMogN6K5xhr0eF8qcFq4HnvnAwua1TzxRwkhZrxQgnNUGLSd59qg-4sCGheYS3-r_aF3j2JLouc0h15X9XI1GCCUOHxQjrZ03NCFul-f6dXb6yj03zJ8KDl-0VtoQLd6EKr99XEa8_V75b8Gqj1M May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:09:43.677121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7733d8b5059433eb18dc6b174eb9533", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: d0427d9cce40423185a40df61c3617a6 May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {"volumeAttachment": {"volumeId": "2ce9befc-c695-477f-b3a3-ae7db309a230"}} May 25 16:09:43.678511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Cannot 'attach_volume' instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 while it is in vm_state rescued May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'server_id': '8f650730-0534-4f4b-92b9-6d6be8cc54c7', 'body': {'volumeAttachment': {'volumeId': '2ce9befc-c695-477f-b3a3-ae7db309a230'}}} May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:09:43.679438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 while it is in vm_state rescued May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:09:43.680799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:09:43.682080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:09:43.682080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:09:43.682080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 while it is in vm_state rescued May 25 16:09:43.682080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:09:43.682080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Returning 409 to user: Cannot 'attach_volume' instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 while it is in vm_state rescued {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:09:43.682080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ed6a279a-0479-4220-b02c-866133db5372 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045348 May 25 16:09:43.682633 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 103/210] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:09:43 2022] POST /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 25 16:09:43.687681 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-45c2db4e-476c-4627-8cf3-ad8a5395c826 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:43.688255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-45c2db4e-476c-4627-8cf3-ad8a5395c826 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:43.694737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45c2db4e-476c-4627-8cf3-ad8a5395c826 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:43.695198 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45c2db4e-476c-4627-8cf3-ad8a5395c826 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:43.696072 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45c2db4e-476c-4627-8cf3-ad8a5395c826 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:43.696507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45c2db4e-476c-4627-8cf3-ad8a5395c826 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:43.765695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-45c2db4e-476c-4627-8cf3-ad8a5395c826 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7/action" status: 202 len: 0 microversion: 2.1 time: 0.081754 May 25 16:09:43.771075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 108/211] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:09:43 2022] POST /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:09:43.775044 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-45ca32b9-8c61-4bac-9818-da531f8be271 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:43.776291 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-45ca32b9-8c61-4bac-9818-da531f8be271 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:43.783684 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-45ca32b9-8c61-4bac-9818-da531f8be271 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:43.784284 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-45ca32b9-8c61-4bac-9818-da531f8be271 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:43.785304 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-45ca32b9-8c61-4bac-9818-da531f8be271 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:43.785582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-45ca32b9-8c61-4bac-9818-da531f8be271 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:43.860160 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1316628397", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "networks": [{"uuid": "454d2741-79ec-4e94-82d2-47867e0733f2"}]}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:43.911186 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] validate_networks() for [('454d2741-79ec-4e94-82d2-47867e0733f2', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:09:44.011479 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-45ca32b9-8c61-4bac-9818-da531f8be271 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:44.019331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-45ca32b9-8c61-4bac-9818-da531f8be271 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1511 microversion: 2.1 time: 0.248493 May 25 16:09:44.020201 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 104/212] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:43 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:44.266144 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:09:44.266637 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:09:44.267118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:09:44.267525 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:09:44.267960 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:09:44.278336 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:44.278796 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:44.279603 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:44.280093 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:44.296933 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Getting quotas for project b32433ec45854be380fcd9a9671a4ce5. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:09:44.301500 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Getting quotas for user 2b909d4c7d9b45b29f995268f8fac987 and project b32433ec45854be380fcd9a9671a4ce5. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:09:44.314264 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:09:44.316683 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:09:44.367755 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-67f2aa72-a8fe-4fd3-8f48-22eb93eeaf8f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511691 May 25 16:09:44.373512 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 109/213] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:09:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:09:44.379187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7dc3de4c-2b09-45c1-9bca-441c4c9abcd3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:44.380004 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-7dc3de4c-2b09-45c1-9bca-441c4c9abcd3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:44.484682 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-7dc3de4c-2b09-45c1-9bca-441c4c9abcd3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:44.493552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-7dc3de4c-2b09-45c1-9bca-441c4c9abcd3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1219 microversion: 2.1 time: 0.118228 May 25 16:09:44.494772 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 105/214] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:44 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:45.037857 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3f01d848-5fd9-4348-a9b9-169a9a08175a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:45.038734 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3f01d848-5fd9-4348-a9b9-169a9a08175a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:45.046585 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3f01d848-5fd9-4348-a9b9-169a9a08175a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:45.047014 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3f01d848-5fd9-4348-a9b9-169a9a08175a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:45.048031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3f01d848-5fd9-4348-a9b9-169a9a08175a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:45.048645 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3f01d848-5fd9-4348-a9b9-169a9a08175a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:45.185938 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3f01d848-5fd9-4348-a9b9-169a9a08175a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:45.194159 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3f01d848-5fd9-4348-a9b9-169a9a08175a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1511 microversion: 2.1 time: 0.160127 May 25 16:09:45.194886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 110/215] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:45 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:45.510959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-bed9d828-c650-45b0-9ce7-4f7b47cafd8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:45.511447 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-bed9d828-c650-45b0-9ce7-4f7b47cafd8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:45.518837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bed9d828-c650-45b0-9ce7-4f7b47cafd8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:45.519288 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bed9d828-c650-45b0-9ce7-4f7b47cafd8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:45.520098 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bed9d828-c650-45b0-9ce7-4f7b47cafd8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:45.520535 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bed9d828-c650-45b0-9ce7-4f7b47cafd8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:45.590212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-bed9d828-c650-45b0-9ce7-4f7b47cafd8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:45.600265 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-bed9d828-c650-45b0-9ce7-4f7b47cafd8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1223 microversion: 2.1 time: 0.092089 May 25 16:09:45.600901 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 106/216] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:45 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:46.212650 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ddc2086c-bd5c-4fdd-9b84-eb7280824175 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:46.212650 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ddc2086c-bd5c-4fdd-9b84-eb7280824175 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:46.219578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddc2086c-bd5c-4fdd-9b84-eb7280824175 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:46.220192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddc2086c-bd5c-4fdd-9b84-eb7280824175 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:46.220896 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddc2086c-bd5c-4fdd-9b84-eb7280824175 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:46.221325 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddc2086c-bd5c-4fdd-9b84-eb7280824175 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:46.363258 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ddc2086c-bd5c-4fdd-9b84-eb7280824175 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:46.370985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ddc2086c-bd5c-4fdd-9b84-eb7280824175 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1511 microversion: 2.1 time: 0.163109 May 25 16:09:46.371552 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 111/217] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:46 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:46.617651 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4e642e10-4652-4d45-9cb9-c62ec7bdad78 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:46.619393 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4e642e10-4652-4d45-9cb9-c62ec7bdad78 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:46.626177 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e642e10-4652-4d45-9cb9-c62ec7bdad78 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:46.626903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e642e10-4652-4d45-9cb9-c62ec7bdad78 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:46.627896 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e642e10-4652-4d45-9cb9-c62ec7bdad78 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:46.628388 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e642e10-4652-4d45-9cb9-c62ec7bdad78 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:46.730715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4e642e10-4652-4d45-9cb9-c62ec7bdad78 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:46.744004 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4e642e10-4652-4d45-9cb9-c62ec7bdad78 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1215 microversion: 2.1 time: 0.130770 May 25 16:09:46.744582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 107/218] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:46 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:47.389247 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5c7587df-cf5d-4430-9311-193b07106180 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:47.389954 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5c7587df-cf5d-4430-9311-193b07106180 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:47.396818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5c7587df-cf5d-4430-9311-193b07106180 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:47.397822 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5c7587df-cf5d-4430-9311-193b07106180 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:47.398179 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5c7587df-cf5d-4430-9311-193b07106180 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:47.398816 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5c7587df-cf5d-4430-9311-193b07106180 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:47.625012 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5c7587df-cf5d-4430-9311-193b07106180 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:47.641227 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5c7587df-cf5d-4430-9311-193b07106180 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1511 microversion: 2.1 time: 0.256694 May 25 16:09:47.641817 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 112/219] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:47 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:47.765603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ceb5e530-8a73-49ab-8d33-b593eabe8bc6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:47.765603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ceb5e530-8a73-49ab-8d33-b593eabe8bc6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:47.773632 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ceb5e530-8a73-49ab-8d33-b593eabe8bc6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:47.774490 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ceb5e530-8a73-49ab-8d33-b593eabe8bc6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:47.775397 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ceb5e530-8a73-49ab-8d33-b593eabe8bc6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:47.775864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ceb5e530-8a73-49ab-8d33-b593eabe8bc6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:47.848600 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ceb5e530-8a73-49ab-8d33-b593eabe8bc6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:47.856300 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ceb5e530-8a73-49ab-8d33-b593eabe8bc6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1277 microversion: 2.1 time: 0.098035 May 25 16:09:47.857082 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 108/220] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:47 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:48.137653 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-20595cd8-4e8c-4ae4-9b0f-e791005b962c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:48.138142 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-20595cd8-4e8c-4ae4-9b0f-e791005b962c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:48.145212 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-20595cd8-4e8c-4ae4-9b0f-e791005b962c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:48.145704 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-20595cd8-4e8c-4ae4-9b0f-e791005b962c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:48.146466 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-20595cd8-4e8c-4ae4-9b0f-e791005b962c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:48.146941 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-20595cd8-4e8c-4ae4-9b0f-e791005b962c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:48.161349 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:48.171388 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-20595cd8-4e8c-4ae4-9b0f-e791005b962c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/ips" status: 200 len: 152 microversion: 2.20 time: 0.037695 May 25 16:09:48.171981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 113/221] 10.222.0.85 () {60 vars in 1288 bytes} [Wed May 25 16:09:48 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:09:48.662934 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9a5bb297-9e73-408a-a132-506ea86b0ed8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:48.664304 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9a5bb297-9e73-408a-a132-506ea86b0ed8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:48.674682 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9a5bb297-9e73-408a-a132-506ea86b0ed8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:48.675433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9a5bb297-9e73-408a-a132-506ea86b0ed8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:48.676767 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9a5bb297-9e73-408a-a132-506ea86b0ed8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:48.677497 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9a5bb297-9e73-408a-a132-506ea86b0ed8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:48.814353 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9a5bb297-9e73-408a-a132-506ea86b0ed8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:48.822487 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9a5bb297-9e73-408a-a132-506ea86b0ed8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1511 microversion: 2.1 time: 0.166241 May 25 16:09:48.823337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 109/222] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:48 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:48.876727 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-75fc44b3-d9e4-4a7b-b2d2-de13ed079fea tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:48.877415 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-75fc44b3-d9e4-4a7b-b2d2-de13ed079fea tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:48.884758 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75fc44b3-d9e4-4a7b-b2d2-de13ed079fea tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:48.885037 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75fc44b3-d9e4-4a7b-b2d2-de13ed079fea tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:48.885801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75fc44b3-d9e4-4a7b-b2d2-de13ed079fea tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:48.886229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75fc44b3-d9e4-4a7b-b2d2-de13ed079fea tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:49.015550 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-75fc44b3-d9e4-4a7b-b2d2-de13ed079fea tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:49.023229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-75fc44b3-d9e4-4a7b-b2d2-de13ed079fea tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1319 microversion: 2.1 time: 0.150805 May 25 16:09:49.023809 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 114/223] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:48 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:49.841563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5379b9c3-64ac-41a9-8451-2e7861169ceb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:49.842232 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5379b9c3-64ac-41a9-8451-2e7861169ceb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:49.845268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=38 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:49.848984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5379b9c3-64ac-41a9-8451-2e7861169ceb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:49.849431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5379b9c3-64ac-41a9-8451-2e7861169ceb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:49.850197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5379b9c3-64ac-41a9-8451-2e7861169ceb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:49.850633 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5379b9c3-64ac-41a9-8451-2e7861169ceb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:49.992317 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5379b9c3-64ac-41a9-8451-2e7861169ceb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:50.000274 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5379b9c3-64ac-41a9-8451-2e7861169ceb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1511 microversion: 2.1 time: 0.164351 May 25 16:09:50.001064 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 110/224] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:49 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:09:50.036910 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-0152cb67-8ba8-47cb-af96-728117ff8c47 req-b4d5ce2f-83f4-49cd-a432-164bab3b7e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8253004a-eb87-4982-963c-d977a69b1508", "tag": "5aa2665a-f27b-4727-a1dc-4d9a102547d8"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:50.045576 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8ebc84ea-01ca-4116-bb8e-b88ff1805480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:50.046224 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8ebc84ea-01ca-4116-bb8e-b88ff1805480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:50.048055 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-0152cb67-8ba8-47cb-af96-728117ff8c47 req-b4d5ce2f-83f4-49cd-a432-164bab3b7e2f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:50.048877 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-0152cb67-8ba8-47cb-af96-728117ff8c47 req-b4d5ce2f-83f4-49cd-a432-164bab3b7e2f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:50.060980 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ebc84ea-01ca-4116-bb8e-b88ff1805480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:50.063063 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ebc84ea-01ca-4116-bb8e-b88ff1805480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:50.064425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ebc84ea-01ca-4116-bb8e-b88ff1805480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:50.065790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ebc84ea-01ca-4116-bb8e-b88ff1805480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:50.072547 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-0152cb67-8ba8-47cb-af96-728117ff8c47 req-b4d5ce2f-83f4-49cd-a432-164bab3b7e2f service nova] Creating event network-changed:5aa2665a-f27b-4727-a1dc-4d9a102547d8 for instance 8253004a-eb87-4982-963c-d977a69b1508 on hv-cinder-84327 May 25 16:09:50.077901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-0152cb67-8ba8-47cb-af96-728117ff8c47 req-b4d5ce2f-83f4-49cd-a432-164bab3b7e2f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045009 May 25 16:09:50.078595 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 115/225] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:09:50.203920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-8ebc84ea-01ca-4116-bb8e-b88ff1805480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:50.211526 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8ebc84ea-01ca-4116-bb8e-b88ff1805480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1319 microversion: 2.1 time: 0.174526 May 25 16:09:50.212268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 111/226] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:50 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:51.022491 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0d21f42f-21c0-4994-9061-ccd801381260 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:51.023636 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0d21f42f-21c0-4994-9061-ccd801381260 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:51.034616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0d21f42f-21c0-4994-9061-ccd801381260 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:51.035351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0d21f42f-21c0-4994-9061-ccd801381260 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:51.036682 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0d21f42f-21c0-4994-9061-ccd801381260 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:51.037398 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0d21f42f-21c0-4994-9061-ccd801381260 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:51.183735 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0d21f42f-21c0-4994-9061-ccd801381260 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:51.192081 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0d21f42f-21c0-4994-9061-ccd801381260 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1517 microversion: 2.1 time: 0.176742 May 25 16:09:51.192725 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 116/227] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:51 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:51.227746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-17eb91d0-9132-4483-bee4-610f8566afd8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:51.228362 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-17eb91d0-9132-4483-bee4-610f8566afd8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:51.234805 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-17eb91d0-9132-4483-bee4-610f8566afd8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:51.235260 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-17eb91d0-9132-4483-bee4-610f8566afd8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:51.236085 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-17eb91d0-9132-4483-bee4-610f8566afd8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:51.236519 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-17eb91d0-9132-4483-bee4-610f8566afd8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:51.239157 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=100 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:51.371509 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-17eb91d0-9132-4483-bee4-610f8566afd8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:51.379463 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-17eb91d0-9132-4483-bee4-610f8566afd8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1319 microversion: 2.1 time: 0.155608 May 25 16:09:51.380000 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 112/228] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:51 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:52.159308 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-dad00e5f-3324-4144-a224-251bd5b7d6c6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:52.159308 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-dad00e5f-3324-4144-a224-251bd5b7d6c6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:52.166146 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dad00e5f-3324-4144-a224-251bd5b7d6c6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:52.166596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dad00e5f-3324-4144-a224-251bd5b7d6c6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:52.167362 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dad00e5f-3324-4144-a224-251bd5b7d6c6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:52.167783 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dad00e5f-3324-4144-a224-251bd5b7d6c6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:52.193268 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-dad00e5f-3324-4144-a224-251bd5b7d6c6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lazy-loading 'flavor' on Instance uuid e80a2c16-520b-48e9-9f83-e643414a8c8e {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:09:52.398053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a674f303-c07e-4c82-844a-241cd28a79a3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:52.399080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a674f303-c07e-4c82-844a-241cd28a79a3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:52.413929 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a674f303-c07e-4c82-844a-241cd28a79a3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:52.414407 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a674f303-c07e-4c82-844a-241cd28a79a3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:52.416267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a674f303-c07e-4c82-844a-241cd28a79a3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:52.416920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a674f303-c07e-4c82-844a-241cd28a79a3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:52.509566 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-dad00e5f-3324-4144-a224-251bd5b7d6c6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/action" status: 202 len: 0 microversion: 2.20 time: 0.355442 May 25 16:09:52.510592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 117/229] 10.222.0.85 () {62 vars in 1318 bytes} [Wed May 25 16:09:52 2022] POST /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 25 16:09:52.520005 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:52.520840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:52.529203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:52.529915 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:52.530720 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:52.531315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:52.569646 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a674f303-c07e-4c82-844a-241cd28a79a3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:52.577563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a674f303-c07e-4c82-844a-241cd28a79a3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1319 microversion: 2.1 time: 0.185111 May 25 16:09:52.579806 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 113/230] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:52 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:09:52.592110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7e3813d4-3ff2-4454-910d-cf93f1711f09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'create', calling method: .version_select at 0x7fbaf01f6f70>, body: {"keypair": {"name": "tempest-keypair-2082148837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXL7DTDMdsL4BhfYJh+rL5nDFBKKqQ8hksWuNC0GiZVjDDBjTSKNQUaF0S9KuDk+xHC1PFl8E6DmDshgymWHhCvu642dAJdp2cyqezeySgZMOjiy7C6UZXFGVuF8OBV6g=="}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:52.607427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-7e3813d4-3ff2-4454-910d-cf93f1711f09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Getting quotas for project f7733d8b5059433eb18dc6b174eb9533. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:09:52.612600 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-7e3813d4-3ff2-4454-910d-cf93f1711f09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Getting quotas for user d0427d9cce40423185a40df61c3617a6 and project f7733d8b5059433eb18dc6b174eb9533. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:09:52.637955 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-7e3813d4-3ff2-4454-910d-cf93f1711f09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056795 May 25 16:09:52.638566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 114/231] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:09:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:09:52.715305 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:52.724447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:52.726477 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:52.727790 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fae5b338-3a83-4110-83dc-4d850a0fd6a8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.213186 May 25 16:09:52.728464 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 118/232] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:09:52 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:09:53.042252 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3e17881e-7c59-4777-8f6b-a681bc6bfdd4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:53.042757 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3e17881e-7c59-4777-8f6b-a681bc6bfdd4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:53.049083 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e17881e-7c59-4777-8f6b-a681bc6bfdd4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:53.049877 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e17881e-7c59-4777-8f6b-a681bc6bfdd4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:53.050844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e17881e-7c59-4777-8f6b-a681bc6bfdd4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:53.051449 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e17881e-7c59-4777-8f6b-a681bc6bfdd4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:53.078715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3e17881e-7c59-4777-8f6b-a681bc6bfdd4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/ips" status: 200 len: 149 microversion: 2.1 time: 0.040485 May 25 16:09:53.079598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 115/233] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:09:53 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:09:53.596918 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-aaecf4e1-8c7a-45ad-8aaa-d8754cc88172 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:53.597532 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-aaecf4e1-8c7a-45ad-8aaa-d8754cc88172 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:53.606481 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-aaecf4e1-8c7a-45ad-8aaa-d8754cc88172 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:53.606927 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-aaecf4e1-8c7a-45ad-8aaa-d8754cc88172 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:53.607689 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-aaecf4e1-8c7a-45ad-8aaa-d8754cc88172 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:53.608136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-aaecf4e1-8c7a-45ad-8aaa-d8754cc88172 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:53.747019 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:53.748391 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:53.755185 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:53.755929 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:53.757488 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:53.758231 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:53.793750 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-aaecf4e1-8c7a-45ad-8aaa-d8754cc88172 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:53.807173 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-aaecf4e1-8c7a-45ad-8aaa-d8754cc88172 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1319 microversion: 2.1 time: 0.211775 May 25 16:09:53.808097 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 119/234] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:53 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:53.989224 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:53.997292 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:53.998756 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:53.999962 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9242daea-8f61-473e-94dc-b0a596718b3f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.257206 May 25 16:09:54.011155 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 116/235] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:09:53 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:09:54.326893 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-285339121", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "877c8ddf-7ab7-4a0d-986b-a567e6cc159c"}], "security_groups": [{"name": "tempest-securitygroup--1277611554"}], "key_name": "tempest-keypair-2082148837", "user_data": "}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:54.337539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:54.338558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:54.436009 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] validate_networks() for [('877c8ddf-7ab7-4a0d-986b-a567e6cc159c', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:09:54.463710 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5b2dd90a-6935-44fc-8642-14576a74b331 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99441362-29b3-4cbd-8eb5-24eb3d16cbda"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:54.464893 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5b2dd90a-6935-44fc-8642-14576a74b331 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:54.471067 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5b2dd90a-6935-44fc-8642-14576a74b331 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:54.471515 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5b2dd90a-6935-44fc-8642-14576a74b331 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:54.472316 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5b2dd90a-6935-44fc-8642-14576a74b331 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:54.472749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5b2dd90a-6935-44fc-8642-14576a74b331 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:54.764277 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5b2dd90a-6935-44fc-8642-14576a74b331 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304439 May 25 16:09:54.765233 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 117/236] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:09:54 2022] POST /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:09:54.825577 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9f936927-9f16-4bbf-97a2-82c37c24918e tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:54.826327 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9f936927-9f16-4bbf-97a2-82c37c24918e tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:54.833712 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9f936927-9f16-4bbf-97a2-82c37c24918e tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:54.834189 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9f936927-9f16-4bbf-97a2-82c37c24918e tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:54.834979 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9f936927-9f16-4bbf-97a2-82c37c24918e tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:54.835502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9f936927-9f16-4bbf-97a2-82c37c24918e tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:54.848008 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:09:54.848497 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:09:54.848959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:09:54.849361 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:09:54.849769 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:09:54.861208 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:54.861625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:54.862417 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:54.863023 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:54.884425 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Getting quotas for project f7733d8b5059433eb18dc6b174eb9533. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:09:54.889338 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Getting quotas for user d0427d9cce40423185a40df61c3617a6 and project f7733d8b5059433eb18dc6b174eb9533. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:09:54.902329 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:09:54.905612 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:09:54.961516 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-eb8611bd-922e-43b3-9664-06c2df641202 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.639018 May 25 16:09:54.967360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 120/237] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:09:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:09:54.973105 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-775c5393-03b1-450a-965b-0007ccc4202a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:54.973874 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-775c5393-03b1-450a-965b-0007ccc4202a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:55.021734 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9f936927-9f16-4bbf-97a2-82c37c24918e tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:55.030343 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9f936927-9f16-4bbf-97a2-82c37c24918e tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1319 microversion: 2.1 time: 0.209622 May 25 16:09:55.031059 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 118/238] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:54 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:09:55.036788 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:55.037935 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:55.044938 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-775c5393-03b1-450a-965b-0007ccc4202a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:55.046823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:55.047368 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:55.048350 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:55.048796 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:55.052790 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-775c5393-03b1-450a-965b-0007ccc4202a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1245 microversion: 2.1 time: 0.084133 May 25 16:09:55.053519 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 121/239] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:54 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:55.195484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:55.203978 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:55.205398 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:55.206626 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f8dbb4ff-b95d-4e3e-8e16-7a9c312ccd03 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.174403 May 25 16:09:55.207220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 119/240] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:09:55 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:09:55.734675 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-cb9110d7-651c-4574-97d8-2b6e27fd4461 req-478a1e75-7dfe-45b7-92d1-d28d3b037287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8253004a-eb87-4982-963c-d977a69b1508", "name": "network-vif-plugged", "status": "completed", "tag": "5aa2665a-f27b-4727-a1dc-4d9a102547d8"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:55.745456 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-cb9110d7-651c-4574-97d8-2b6e27fd4461 req-478a1e75-7dfe-45b7-92d1-d28d3b037287 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:55.745900 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-cb9110d7-651c-4574-97d8-2b6e27fd4461 req-478a1e75-7dfe-45b7-92d1-d28d3b037287 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:55.756871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-cb9110d7-651c-4574-97d8-2b6e27fd4461 req-478a1e75-7dfe-45b7-92d1-d28d3b037287 service nova] Creating event network-vif-plugged:5aa2665a-f27b-4727-a1dc-4d9a102547d8 for instance 8253004a-eb87-4982-963c-d977a69b1508 on hv-cinder-84327 May 25 16:09:55.761824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-cb9110d7-651c-4574-97d8-2b6e27fd4461 req-478a1e75-7dfe-45b7-92d1-d28d3b037287 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 May 25 16:09:55.762408 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 122/241] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:09:56.046713 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8d5f77e7-981a-459f-8b81-ac02c6916510 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:56.047423 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8d5f77e7-981a-459f-8b81-ac02c6916510 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:56.055882 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8d5f77e7-981a-459f-8b81-ac02c6916510 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:56.056538 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8d5f77e7-981a-459f-8b81-ac02c6916510 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:56.057462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8d5f77e7-981a-459f-8b81-ac02c6916510 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:56.058049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8d5f77e7-981a-459f-8b81-ac02c6916510 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:56.071045 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c7d5a458-e437-4d72-83e1-c66dae2f2429 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:56.072567 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c7d5a458-e437-4d72-83e1-c66dae2f2429 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:56.081231 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c7d5a458-e437-4d72-83e1-c66dae2f2429 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:56.082139 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c7d5a458-e437-4d72-83e1-c66dae2f2429 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:56.083797 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c7d5a458-e437-4d72-83e1-c66dae2f2429 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:56.084580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c7d5a458-e437-4d72-83e1-c66dae2f2429 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:56.234267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-8d5f77e7-981a-459f-8b81-ac02c6916510 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:56.243394 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8d5f77e7-981a-459f-8b81-ac02c6916510 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1319 microversion: 2.1 time: 0.200366 May 25 16:09:56.244198 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 120/242] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:56 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:56.249369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:56.250185 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:56.258922 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c7d5a458-e437-4d72-83e1-c66dae2f2429 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:56.259979 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:56.260436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:56.261422 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:56.262034 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:56.267347 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c7d5a458-e437-4d72-83e1-c66dae2f2429 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1297 microversion: 2.1 time: 0.201422 May 25 16:09:56.268172 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 123/243] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:56 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1297 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:56.414281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:56.422344 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:56.423866 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:56.425018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2e382135-87f9-4c64-bf78-a309073886ca tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.179686 May 25 16:09:56.425568 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 121/244] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:09:56 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:09:57.261119 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-bdccb7d5-4d32-4e97-8fd9-960d44192e6d tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:57.262501 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-bdccb7d5-4d32-4e97-8fd9-960d44192e6d tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:57.270049 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bdccb7d5-4d32-4e97-8fd9-960d44192e6d tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:57.270709 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bdccb7d5-4d32-4e97-8fd9-960d44192e6d tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:57.271569 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bdccb7d5-4d32-4e97-8fd9-960d44192e6d tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:57.272285 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bdccb7d5-4d32-4e97-8fd9-960d44192e6d tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:57.297874 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1178737a-a147-49d6-a25b-bdf84489ff0b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:57.299978 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1178737a-a147-49d6-a25b-bdf84489ff0b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:57.308963 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1178737a-a147-49d6-a25b-bdf84489ff0b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:57.309490 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1178737a-a147-49d6-a25b-bdf84489ff0b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:57.310177 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1178737a-a147-49d6-a25b-bdf84489ff0b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:57.310611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1178737a-a147-49d6-a25b-bdf84489ff0b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:57.480523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1178737a-a147-49d6-a25b-bdf84489ff0b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:57.489185 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1178737a-a147-49d6-a25b-bdf84489ff0b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.207682 May 25 16:09:57.490145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 122/245] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:57 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:57.499955 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:57.500591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:57.508194 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:57.508913 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:57.509853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:57.510281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:57.542724 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-bdccb7d5-4d32-4e97-8fd9-960d44192e6d tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:57.551368 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-bdccb7d5-4d32-4e97-8fd9-960d44192e6d tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1319 microversion: 2.1 time: 0.294550 May 25 16:09:57.553172 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 124/246] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:57 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:57.660494 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:57.670232 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:57.672108 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:57.673485 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-98bae5d0-6c38-41d6-a70d-a22a78c8a11e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.181865 May 25 16:09:57.674286 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 123/247] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:09:57 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:09:58.269977 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-12f6485e-148b-4fb8-badd-87310e5776e6 req-45ccd640-6709-4fba-a915-9fcb7ea2671a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3950b05-a514-47cb-8eee-c63d90575a10", "tag": "9dc3e056-237c-4546-af66-e3fc4e599215"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:09:58.279749 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-12f6485e-148b-4fb8-badd-87310e5776e6 req-45ccd640-6709-4fba-a915-9fcb7ea2671a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:58.280216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-12f6485e-148b-4fb8-badd-87310e5776e6 req-45ccd640-6709-4fba-a915-9fcb7ea2671a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:58.300144 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-12f6485e-148b-4fb8-badd-87310e5776e6 req-45ccd640-6709-4fba-a915-9fcb7ea2671a service nova] Creating event network-changed:9dc3e056-237c-4546-af66-e3fc4e599215 for instance a3950b05-a514-47cb-8eee-c63d90575a10 on hv-cinder-84327 May 25 16:09:58.305434 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-12f6485e-148b-4fb8-badd-87310e5776e6 req-45ccd640-6709-4fba-a915-9fcb7ea2671a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039784 May 25 16:09:58.306036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 125/248] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:09:58.506572 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3a67db3a-be5b-411d-8d52-64323fad35a6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:58.507187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3a67db3a-be5b-411d-8d52-64323fad35a6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:58.514145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a67db3a-be5b-411d-8d52-64323fad35a6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:58.514594 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a67db3a-be5b-411d-8d52-64323fad35a6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:58.515419 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a67db3a-be5b-411d-8d52-64323fad35a6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:58.515847 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a67db3a-be5b-411d-8d52-64323fad35a6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:58.562041 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-62817833-e1ae-4010-8ebc-5c7fc946ef03 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:58.562492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-62817833-e1ae-4010-8ebc-5c7fc946ef03 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:58.570128 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62817833-e1ae-4010-8ebc-5c7fc946ef03 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:58.570831 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62817833-e1ae-4010-8ebc-5c7fc946ef03 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:58.571777 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62817833-e1ae-4010-8ebc-5c7fc946ef03 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:58.572379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62817833-e1ae-4010-8ebc-5c7fc946ef03 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:58.608829 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-62817833-e1ae-4010-8ebc-5c7fc946ef03 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/ips" status: 200 len: 146 microversion: 2.1 time: 0.051110 May 25 16:09:58.609593 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 126/249] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:09:58 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:09:58.615973 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9f4015ee-2551-4f81-9a3c-d936ec1c8b4f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:58.616831 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9f4015ee-2551-4f81-9a3c-d936ec1c8b4f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:58.624049 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f4015ee-2551-4f81-9a3c-d936ec1c8b4f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:58.624706 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f4015ee-2551-4f81-9a3c-d936ec1c8b4f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:58.625488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f4015ee-2551-4f81-9a3c-d936ec1c8b4f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:58.625925 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f4015ee-2551-4f81-9a3c-d936ec1c8b4f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:58.739198 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3a67db3a-be5b-411d-8d52-64323fad35a6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:58.748676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3a67db3a-be5b-411d-8d52-64323fad35a6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.245752 May 25 16:09:58.749645 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 124/250] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:58 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:09:58.762815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:58.763674 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:58.770585 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:58.771058 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:58.771848 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:58.772302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:58.890601 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9f4015ee-2551-4f81-9a3c-d936ec1c8b4f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:58.900096 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9f4015ee-2551-4f81-9a3c-d936ec1c8b4f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1508 microversion: 2.1 time: 0.288472 May 25 16:09:58.901207 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 127/251] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:58 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:58.917603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:58.929153 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:58.930804 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:58.932241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-df498f9c-2b0f-42ac-960d-7b7d44003950 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.174157 May 25 16:09:58.932955 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 125/252] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:09:58 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:09:59.766878 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4cb0f186-5bf4-4850-bb4f-ab25373d8a5c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:59.767623 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4cb0f186-5bf4-4850-bb4f-ab25373d8a5c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:59.774792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4cb0f186-5bf4-4850-bb4f-ab25373d8a5c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:59.775312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4cb0f186-5bf4-4850-bb4f-ab25373d8a5c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:59.776198 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4cb0f186-5bf4-4850-bb4f-ab25373d8a5c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:59.776703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4cb0f186-5bf4-4850-bb4f-ab25373d8a5c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:59.916775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4cb0f186-5bf4-4850-bb4f-ab25373d8a5c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:09:59.924161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4cb0f186-5bf4-4850-bb4f-ab25373d8a5c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.161379 May 25 16:09:59.924710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 128/253] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:09:59 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:09:59.954149 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:09:59.954736 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:09:59.962872 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:59.963318 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:09:59.964106 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:09:59.964536 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:00.098450 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:00.106556 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:00.108084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:00.109448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e7b774b1-462a-4887-be1d-27aecaec8f79 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.159215 May 25 16:10:00.110043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 126/254] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:09:59 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:00.944388 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-15427dd0-97d2-4b16-b6ec-c01cdd32e68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:00.945670 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-15427dd0-97d2-4b16-b6ec-c01cdd32e68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:00.955249 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15427dd0-97d2-4b16-b6ec-c01cdd32e68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:00.955706 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15427dd0-97d2-4b16-b6ec-c01cdd32e68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:00.956536 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15427dd0-97d2-4b16-b6ec-c01cdd32e68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:00.956956 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15427dd0-97d2-4b16-b6ec-c01cdd32e68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:01.092879 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-15427dd0-97d2-4b16-b6ec-c01cdd32e68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:01.100712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-15427dd0-97d2-4b16-b6ec-c01cdd32e68d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.162878 May 25 16:10:01.101285 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 129/255] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:00 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:01.128411 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:01.128999 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:01.135761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:01.136226 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:01.136976 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:01.137407 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:01.282428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:01.291496 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:01.293047 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:01.294212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-411cca8d-55d2-443a-8c27-98b2334149a9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.169887 May 25 16:10:01.294781 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 127/256] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:01 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:10:01.604758 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3a3ecbcd-f0f6-4df5-800b-9b31793841e6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "177e2d77-58e3-4a1d-be11-02f454f8616b"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:01.605812 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3a3ecbcd-f0f6-4df5-800b-9b31793841e6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:01.611746 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3a3ecbcd-f0f6-4df5-800b-9b31793841e6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:01.612239 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3a3ecbcd-f0f6-4df5-800b-9b31793841e6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:01.612996 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3a3ecbcd-f0f6-4df5-800b-9b31793841e6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:01.613426 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3a3ecbcd-f0f6-4df5-800b-9b31793841e6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:02.086068 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3a3ecbcd-f0f6-4df5-800b-9b31793841e6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485276 May 25 16:10:02.086824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 130/257] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:10:01 2022] POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:10:02.119752 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c7483e73-581c-43cd-b880-01377e267d4a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:02.120545 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c7483e73-581c-43cd-b880-01377e267d4a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:02.127439 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7483e73-581c-43cd-b880-01377e267d4a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:02.128268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7483e73-581c-43cd-b880-01377e267d4a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:02.129051 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7483e73-581c-43cd-b880-01377e267d4a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:02.129647 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7483e73-581c-43cd-b880-01377e267d4a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:02.281786 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c7483e73-581c-43cd-b880-01377e267d4a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:02.284363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:02.293622 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c7483e73-581c-43cd-b880-01377e267d4a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.179175 May 25 16:10:02.294811 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 128/258] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:02 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:02.314263 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:02.315049 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:02.323868 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:02.323868 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:02.323868 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:02.324207 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:02.340756 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:02.376979 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-86d8324a-ab42-43b2-87c7-4ae6012f6ac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: .version_select at 0x7fbaf01703a0>, body: {"keypair": {"name": "tempest-keypair-1742066034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmPq2Gu8m4+xB6L9D7oUt37pmOLGwAv5uqSR5J/+O4UgpzK3Autmu86/om5pizVSkVOjCYJ9PekdLSJRUG9u+JSG1lHUYd2f805/prb0x7hsw+9NwWbbWY5ikm+30JGDQ=="}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:02.393723 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-86d8324a-ab42-43b2-87c7-4ae6012f6ac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for project 32e48e8e884b4840ba54d546d82d2334. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:10:02.397624 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-86d8324a-ab42-43b2-87c7-4ae6012f6ac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for user 708fdc537e1747d7bd5917ed7af9c368 and project 32e48e8e884b4840ba54d546d82d2334. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:10:02.421635 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-86d8324a-ab42-43b2-87c7-4ae6012f6ac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050234 May 25 16:10:02.422431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 129/259] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:10:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:10:02.475781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:02.485306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:02.486733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:02.487966 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e03e478e-9e45-4b22-9441-296eca4ed031 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.178456 May 25 16:10:02.488700 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 131/260] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:02 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:03.315054 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e70eebc1-ede6-46aa-a922-53fb4998c109 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:03.315657 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e70eebc1-ede6-46aa-a922-53fb4998c109 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:03.322008 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e70eebc1-ede6-46aa-a922-53fb4998c109 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:03.322419 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e70eebc1-ede6-46aa-a922-53fb4998c109 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:03.323246 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e70eebc1-ede6-46aa-a922-53fb4998c109 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:03.323643 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e70eebc1-ede6-46aa-a922-53fb4998c109 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:03.507676 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:03.508461 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:03.515332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:03.515782 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:03.516592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:03.517025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:03.573766 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e70eebc1-ede6-46aa-a922-53fb4998c109 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:03.588524 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e70eebc1-ede6-46aa-a922-53fb4998c109 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.277869 May 25 16:10:03.591485 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 130/261] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:03 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:03.936332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:03.944579 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:03.946171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:03.947578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d21bfafe-21c6-47a5-b1b8-e7437684d6e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.444652 May 25 16:10:03.948707 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 132/262] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:03 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:04.096518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-189155497", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2dc3f38-efe8-41d0-ba54-fbd07705ad76"}], "security_groups": [{"name": "tempest-securitygroup--1890568650"}], "key_name": "tempest-keypair-1742066034", "user_data": "}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:04.209289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.network.neutron [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] validate_networks() for [('a2dc3f38-efe8-41d0-ba54-fbd07705ad76', None, None, None, None, None)] {{(pid=117764) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:10:04.606793 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2922b661-a49e-48ff-9194-3a97289645b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:04.607324 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2922b661-a49e-48ff-9194-3a97289645b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:04.609667 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Flavor limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:10:04.610100 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Image limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:10:04.610560 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Flavor pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:10:04.610954 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Image pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:10:04.611378 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:10:04.614387 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2922b661-a49e-48ff-9194-3a97289645b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:04.614828 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2922b661-a49e-48ff-9194-3a97289645b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:04.615601 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2922b661-a49e-48ff-9194-3a97289645b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:04.616060 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2922b661-a49e-48ff-9194-3a97289645b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:04.620551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:04.620988 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:04.621778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:04.622215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:04.639859 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for project 32e48e8e884b4840ba54d546d82d2334. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:10:04.643573 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for user 708fdc537e1747d7bd5917ed7af9c368 and project 32e48e8e884b4840ba54d546d82d2334. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:10:04.656307 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Going to run 1 instances... {{(pid=117764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:10:04.659269 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:10:04.708446 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-535603c5-3939-461b-98b7-355850c60ee2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.616175 May 25 16:10:04.709099 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 131/263] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:10:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:10:04.719123 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-727f8d80-1579-410a-8bc2-aaef0adacc74 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:04.719994 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-727f8d80-1579-410a-8bc2-aaef0adacc74 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:04.763973 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2922b661-a49e-48ff-9194-3a97289645b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:04.772006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2922b661-a49e-48ff-9194-3a97289645b1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.169179 May 25 16:10:04.772586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 133/264] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:04 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:10:04.780674 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-727f8d80-1579-410a-8bc2-aaef0adacc74 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:04.787783 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-727f8d80-1579-410a-8bc2-aaef0adacc74 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1241 microversion: 2.1 time: 0.072235 May 25 16:10:04.788232 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 132/265] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:04 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:10:04.967046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:04.967796 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:04.969796 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:04.976281 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:04.976816 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:04.977721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:04.978198 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:05.049712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=8 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:05.119688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:05.128448 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:05.129929 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:05.131108 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4c9cef11-600d-4496-90b0-5a7bbfd72c82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.168641 May 25 16:10:05.131661 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 134/266] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:04 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:05.782921 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-e470ef2e-562e-42c9-b356-6b63c5fb0a54 req-1b1776e8-708d-400e-871a-45aee489ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3950b05-a514-47cb-8eee-c63d90575a10", "name": "network-vif-plugged", "status": "completed", "tag": "9dc3e056-237c-4546-af66-e3fc4e599215"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:05.789648 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c5bac535-aeef-45df-8ad0-6046e7a1b29c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:05.790840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c5bac535-aeef-45df-8ad0-6046e7a1b29c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:05.794480 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-e470ef2e-562e-42c9-b356-6b63c5fb0a54 req-1b1776e8-708d-400e-871a-45aee489ce1f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:05.794871 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-e470ef2e-562e-42c9-b356-6b63c5fb0a54 req-1b1776e8-708d-400e-871a-45aee489ce1f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:05.801946 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5bac535-aeef-45df-8ad0-6046e7a1b29c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:05.802397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5bac535-aeef-45df-8ad0-6046e7a1b29c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:05.803174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5bac535-aeef-45df-8ad0-6046e7a1b29c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:05.803615 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5bac535-aeef-45df-8ad0-6046e7a1b29c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:05.808531 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-e470ef2e-562e-42c9-b356-6b63c5fb0a54 req-1b1776e8-708d-400e-871a-45aee489ce1f service nova] Creating event network-vif-plugged:9dc3e056-237c-4546-af66-e3fc4e599215 for instance a3950b05-a514-47cb-8eee-c63d90575a10 on hv-cinder-84327 May 25 16:10:05.814191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-e470ef2e-562e-42c9-b356-6b63c5fb0a54 req-1b1776e8-708d-400e-871a-45aee489ce1f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035045 May 25 16:10:05.814966 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 133/267] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:05.820201 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b791516b-1eb6-4abc-ab54-0eb2266a294a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:05.820951 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b791516b-1eb6-4abc-ab54-0eb2266a294a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:05.827326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b791516b-1eb6-4abc-ab54-0eb2266a294a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:05.827743 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b791516b-1eb6-4abc-ab54-0eb2266a294a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:05.828843 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b791516b-1eb6-4abc-ab54-0eb2266a294a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:05.829323 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b791516b-1eb6-4abc-ab54-0eb2266a294a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:05.913196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b791516b-1eb6-4abc-ab54-0eb2266a294a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:05.926990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b791516b-1eb6-4abc-ab54-0eb2266a294a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1301 microversion: 2.1 time: 0.110597 May 25 16:10:05.928187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 134/268] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:05 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:06.123005 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c5bac535-aeef-45df-8ad0-6046e7a1b29c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:06.130824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c5bac535-aeef-45df-8ad0-6046e7a1b29c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.345512 May 25 16:10:06.131408 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 135/269] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:05 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:06.151503 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:06.152138 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:06.158260 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:06.158704 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:06.159457 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:06.159966 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:06.296357 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:06.307316 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:06.308852 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:06.310108 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6633052a-d491-49d7-8a7f-3da239d18514 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.163309 May 25 16:10:06.311024 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 135/270] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:06 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:06.948569 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-11eef8a7-f851-48c0-a468-f6b5f1162dde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:06.949901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-11eef8a7-f851-48c0-a468-f6b5f1162dde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:06.960939 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-11eef8a7-f851-48c0-a468-f6b5f1162dde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:06.961573 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-11eef8a7-f851-48c0-a468-f6b5f1162dde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:06.962558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-11eef8a7-f851-48c0-a468-f6b5f1162dde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:06.963171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-11eef8a7-f851-48c0-a468-f6b5f1162dde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:07.149839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5cf683e6-1d65-4468-8eed-0a580241383f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:07.150585 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5cf683e6-1d65-4468-8eed-0a580241383f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:07.157247 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5cf683e6-1d65-4468-8eed-0a580241383f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:07.157696 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5cf683e6-1d65-4468-8eed-0a580241383f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:07.158477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5cf683e6-1d65-4468-8eed-0a580241383f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:07.158912 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5cf683e6-1d65-4468-8eed-0a580241383f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:07.218879 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-11eef8a7-f851-48c0-a468-f6b5f1162dde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:07.227476 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-11eef8a7-f851-48c0-a468-f6b5f1162dde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.285828 May 25 16:10:07.229526 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 136/271] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:06 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:07.296549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5cf683e6-1d65-4468-8eed-0a580241383f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:07.305023 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5cf683e6-1d65-4468-8eed-0a580241383f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.159981 May 25 16:10:07.306084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 136/272] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:07 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:07.328294 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:07.328904 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:07.334767 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:07.335209 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:07.336026 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:07.336619 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:07.538356 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:07.549630 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:07.551172 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:07.552387 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-00fa819a-3ced-41c4-bd41-d65ba57cfdac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.227973 May 25 16:10:07.552944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 137/273] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:07 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:07.660492 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-049d6e05-37b0-40ea-9e5e-e5d4b0e2b8e5 req-cac54418-c9e1-4e38-aab6-b3474da1dd2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b50f41-74ab-479c-898d-14e7396de0bb", "tag": "ac4617cf-b210-4ee5-8011-34c4c46ae91a"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:07.670182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-049d6e05-37b0-40ea-9e5e-e5d4b0e2b8e5 req-cac54418-c9e1-4e38-aab6-b3474da1dd2d service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:07.670627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-049d6e05-37b0-40ea-9e5e-e5d4b0e2b8e5 req-cac54418-c9e1-4e38-aab6-b3474da1dd2d service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:07.689826 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-049d6e05-37b0-40ea-9e5e-e5d4b0e2b8e5 req-cac54418-c9e1-4e38-aab6-b3474da1dd2d service nova] Creating event network-changed:ac4617cf-b210-4ee5-8011-34c4c46ae91a for instance 53b50f41-74ab-479c-898d-14e7396de0bb on hv-cinder-84327 May 25 16:10:07.695323 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-049d6e05-37b0-40ea-9e5e-e5d4b0e2b8e5 req-cac54418-c9e1-4e38-aab6-b3474da1dd2d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039212 May 25 16:10:07.696134 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 137/274] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:08.245636 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-288bf860-8f75-4778-87b2-daa7c1b8f656 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:08.246236 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-288bf860-8f75-4778-87b2-daa7c1b8f656 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:08.253576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-288bf860-8f75-4778-87b2-daa7c1b8f656 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:08.254044 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-288bf860-8f75-4778-87b2-daa7c1b8f656 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:08.254835 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-288bf860-8f75-4778-87b2-daa7c1b8f656 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:08.255286 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-288bf860-8f75-4778-87b2-daa7c1b8f656 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:08.323801 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-96166dbd-03c3-4342-a835-9c4f5b1933a8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:08.324547 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-96166dbd-03c3-4342-a835-9c4f5b1933a8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:08.331132 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-96166dbd-03c3-4342-a835-9c4f5b1933a8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:08.331583 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-96166dbd-03c3-4342-a835-9c4f5b1933a8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:08.332383 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-96166dbd-03c3-4342-a835-9c4f5b1933a8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:08.332820 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-96166dbd-03c3-4342-a835-9c4f5b1933a8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:08.398085 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-288bf860-8f75-4778-87b2-daa7c1b8f656 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:08.405806 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-288bf860-8f75-4778-87b2-daa7c1b8f656 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.164425 May 25 16:10:08.413970 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 138/275] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:08 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:08.473560 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-96166dbd-03c3-4342-a835-9c4f5b1933a8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:08.481131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-96166dbd-03c3-4342-a835-9c4f5b1933a8 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.162183 May 25 16:10:08.481707 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 138/276] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:08 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:08.570927 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:08.571613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:08.578210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:08.578658 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:08.579555 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:08.580039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:08.717592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:08.726162 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:08.727774 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:08.729080 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5afc3537-6341-4a7e-82c7-a2423e97bb82 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.162225 May 25 16:10:08.729646 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 139/277] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:08 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:09.424034 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-72b5f7e1-ea5c-4bb6-9986-23e6899625b5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:09.424917 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-72b5f7e1-ea5c-4bb6-9986-23e6899625b5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:09.433067 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72b5f7e1-ea5c-4bb6-9986-23e6899625b5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:09.433596 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72b5f7e1-ea5c-4bb6-9986-23e6899625b5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:09.434482 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72b5f7e1-ea5c-4bb6-9986-23e6899625b5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:09.434969 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72b5f7e1-ea5c-4bb6-9986-23e6899625b5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:09.498490 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c9b7f7e0-53fa-4426-9c23-00dc725ddb5b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:09.499089 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c9b7f7e0-53fa-4426-9c23-00dc725ddb5b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:09.505990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c9b7f7e0-53fa-4426-9c23-00dc725ddb5b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:09.506440 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c9b7f7e0-53fa-4426-9c23-00dc725ddb5b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:09.507217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c9b7f7e0-53fa-4426-9c23-00dc725ddb5b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:09.507655 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c9b7f7e0-53fa-4426-9c23-00dc725ddb5b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:09.573877 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-72b5f7e1-ea5c-4bb6-9986-23e6899625b5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:09.581938 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-72b5f7e1-ea5c-4bb6-9986-23e6899625b5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.162524 May 25 16:10:09.582590 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 139/278] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:09 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:09.640525 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c9b7f7e0-53fa-4426-9c23-00dc725ddb5b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:09.648432 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c9b7f7e0-53fa-4426-9c23-00dc725ddb5b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.153936 May 25 16:10:09.648998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 140/279] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:09 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:09.747882 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:09.748494 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:09.755151 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:09.755609 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:09.756407 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:09.756842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:09.896221 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:09.904795 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:09.906302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:09.907457 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f9fd35f7-1fad-481e-8e36-732ba9066050 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.163751 May 25 16:10:09.908065 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 140/280] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:09 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:10.598524 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f307f674-c2a9-42c2-95e6-591031d6b938 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:10.599125 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f307f674-c2a9-42c2-95e6-591031d6b938 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:10.601519 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:10.606729 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f307f674-c2a9-42c2-95e6-591031d6b938 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:10.607168 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f307f674-c2a9-42c2-95e6-591031d6b938 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:10.607930 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f307f674-c2a9-42c2-95e6-591031d6b938 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:10.608374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f307f674-c2a9-42c2-95e6-591031d6b938 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:10.665474 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-49c877b1-14ac-4482-8125-9ecbdc5d3fca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:10.666110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-49c877b1-14ac-4482-8125-9ecbdc5d3fca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:10.668552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:10.673987 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-49c877b1-14ac-4482-8125-9ecbdc5d3fca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:10.674436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-49c877b1-14ac-4482-8125-9ecbdc5d3fca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:10.675203 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-49c877b1-14ac-4482-8125-9ecbdc5d3fca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:10.675660 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-49c877b1-14ac-4482-8125-9ecbdc5d3fca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:10.744208 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f307f674-c2a9-42c2-95e6-591031d6b938 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:10.751770 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f307f674-c2a9-42c2-95e6-591031d6b938 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.157075 May 25 16:10:10.752371 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 141/281] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:10 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:10.814162 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-49c877b1-14ac-4482-8125-9ecbdc5d3fca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:10.821793 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-49c877b1-14ac-4482-8125-9ecbdc5d3fca tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1371 microversion: 2.1 time: 0.160341 May 25 16:10:10.822366 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 141/282] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:10 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:10:10.928319 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:10.929157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:10.938448 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:10.939045 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:10.940124 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:10.940699 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:11.082471 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:11.095315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:11.097724 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:11.098870 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6b643304-de7d-43dd-b9d7-1c7989032b46 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.175892 May 25 16:10:11.099434 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 142/283] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:10 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:11.769056 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-77970511-aa5c-411c-aec4-4b94b5a250f2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:11.769639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-77970511-aa5c-411c-aec4-4b94b5a250f2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:11.777159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-77970511-aa5c-411c-aec4-4b94b5a250f2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:11.777614 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-77970511-aa5c-411c-aec4-4b94b5a250f2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:11.778378 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-77970511-aa5c-411c-aec4-4b94b5a250f2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:11.778814 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-77970511-aa5c-411c-aec4-4b94b5a250f2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:11.838958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1355ba88-0f7d-415d-81a9-1f76f3129a51 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:11.839549 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1355ba88-0f7d-415d-81a9-1f76f3129a51 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:11.846601 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1355ba88-0f7d-415d-81a9-1f76f3129a51 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:11.847061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1355ba88-0f7d-415d-81a9-1f76f3129a51 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:11.848109 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1355ba88-0f7d-415d-81a9-1f76f3129a51 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:11.848569 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1355ba88-0f7d-415d-81a9-1f76f3129a51 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:11.912933 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-77970511-aa5c-411c-aec4-4b94b5a250f2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:11.921023 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-77970511-aa5c-411c-aec4-4b94b5a250f2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.155896 May 25 16:10:11.921583 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 142/284] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:11 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:11.985429 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1355ba88-0f7d-415d-81a9-1f76f3129a51 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:11.993220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1355ba88-0f7d-415d-81a9-1f76f3129a51 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1565 microversion: 2.1 time: 0.158285 May 25 16:10:11.993812 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 143/285] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:11 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:12.009761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e115ec5c-286a-48bc-8e15-52ee26159092 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:12.010251 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e115ec5c-286a-48bc-8e15-52ee26159092 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:12.016569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e115ec5c-286a-48bc-8e15-52ee26159092 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:12.017010 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e115ec5c-286a-48bc-8e15-52ee26159092 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:12.017764 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e115ec5c-286a-48bc-8e15-52ee26159092 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:12.018197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e115ec5c-286a-48bc-8e15-52ee26159092 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:12.101080 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e115ec5c-286a-48bc-8e15-52ee26159092 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095268 May 25 16:10:12.101837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 143/286] 10.222.0.85 () {58 vars in 1274 bytes} [Wed May 25 16:10:12 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:12.118575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:12.119493 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:12.125892 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:12.126656 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:12.127994 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:12.128722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:12.318162 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:12.326939 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:12.328788 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:12.329942 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-dcc010ca-9890-4329-9a5f-d4f3451d9cd0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1745 microversion: 2.20 time: 0.215645 May 25 16:10:12.330529 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 144/287] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:12 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1745 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:12.939339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4bc858ca-cbe1-4ab3-8c70-0afda7c7511c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:12.939989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4bc858ca-cbe1-4ab3-8c70-0afda7c7511c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:12.946139 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4bc858ca-cbe1-4ab3-8c70-0afda7c7511c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:12.946580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4bc858ca-cbe1-4ab3-8c70-0afda7c7511c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:12.947360 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4bc858ca-cbe1-4ab3-8c70-0afda7c7511c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:12.947753 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4bc858ca-cbe1-4ab3-8c70-0afda7c7511c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:13.231798 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4bc858ca-cbe1-4ab3-8c70-0afda7c7511c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:13.240874 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4bc858ca-cbe1-4ab3-8c70-0afda7c7511c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.305879 May 25 16:10:13.241705 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 144/288] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:12 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:13.316414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-067b3f64-4812-47e7-a82a-d32ba3dec617 req-184ef6e1-a70f-4234-a6c0-f33809a665eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3950b05-a514-47cb-8eee-c63d90575a10", "tag": "9dc3e056-237c-4546-af66-e3fc4e599215"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:13.326400 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-067b3f64-4812-47e7-a82a-d32ba3dec617 req-184ef6e1-a70f-4234-a6c0-f33809a665eb service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:13.327182 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-067b3f64-4812-47e7-a82a-d32ba3dec617 req-184ef6e1-a70f-4234-a6c0-f33809a665eb service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:13.339456 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-067b3f64-4812-47e7-a82a-d32ba3dec617 req-184ef6e1-a70f-4234-a6c0-f33809a665eb service nova] Creating event network-changed:9dc3e056-237c-4546-af66-e3fc4e599215 for instance a3950b05-a514-47cb-8eee-c63d90575a10 on hv-cinder-84327 May 25 16:10:13.345085 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-067b3f64-4812-47e7-a82a-d32ba3dec617 req-184ef6e1-a70f-4234-a6c0-f33809a665eb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034885 May 25 16:10:13.346102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 145/289] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:13.353470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:13.354268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:13.360627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:13.361278 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:13.362365 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:13.362942 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:13.514403 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:13.524063 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:13.525734 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:13.526916 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a4cf89a3-e40d-417d-a271-f8a298f0e5ba tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1745 microversion: 2.20 time: 0.178707 May 25 16:10:13.527481 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 145/290] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:13 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:10:13.946627 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-cfb73eb1-389d-409c-9337-0574effb6d37 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:13.953316 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cfb73eb1-389d-409c-9337-0574effb6d37 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:13.953732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cfb73eb1-389d-409c-9337-0574effb6d37 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:14.017977 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-cfb73eb1-389d-409c-9337-0574effb6d37 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Going to try to stop instance {{(pid=117763) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 16:10:14.063335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-cfb73eb1-389d-409c-9337-0574effb6d37 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/action" status: 202 len: 0 microversion: 2.1 time: 0.120833 May 25 16:10:14.064112 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 146/291] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:10:13 2022] POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:10:14.072494 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-bac1f662-46bb-470a-b78c-52813598d41f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:14.073098 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-bac1f662-46bb-470a-b78c-52813598d41f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:14.079708 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bac1f662-46bb-470a-b78c-52813598d41f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:14.080272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bac1f662-46bb-470a-b78c-52813598d41f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:14.081279 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bac1f662-46bb-470a-b78c-52813598d41f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:14.081488 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bac1f662-46bb-470a-b78c-52813598d41f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:14.227350 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-bac1f662-46bb-470a-b78c-52813598d41f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:14.235717 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-bac1f662-46bb-470a-b78c-52813598d41f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.167119 May 25 16:10:14.236547 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 146/292] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:14 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:10:14.258807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d852b178-3b8a-483c-8519-685a744b47c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:14.259580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d852b178-3b8a-483c-8519-685a744b47c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:14.266073 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d852b178-3b8a-483c-8519-685a744b47c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:14.266511 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d852b178-3b8a-483c-8519-685a744b47c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:14.267301 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d852b178-3b8a-483c-8519-685a744b47c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:14.267752 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d852b178-3b8a-483c-8519-685a744b47c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:14.284450 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:14.414954 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d852b178-3b8a-483c-8519-685a744b47c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:14.423229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d852b178-3b8a-483c-8519-685a744b47c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.168584 May 25 16:10:14.423919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 147/293] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:14 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:14.546378 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:14.546995 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:14.554197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:14.554637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:14.555396 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:14.555848 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:14.629886 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:14.698890 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:14.707618 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:14.709273 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:14.710550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ed18968e-e34f-4b65-92bc-97e27491d70b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1745 microversion: 2.20 time: 0.168370 May 25 16:10:14.711261 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 147/294] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:14 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:14.754684 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-b07de2d2-71da-4360-ad75-4bfdff7aae40 req-1be8bda4-db0c-49ca-996d-057e55f03457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80a2c16-520b-48e9-9f83-e643414a8c8e", "name": "network-vif-plugged", "status": "completed", "tag": "4bf95a69-e3e3-4ef3-aeeb-8e9c69077969"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:14.763953 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-b07de2d2-71da-4360-ad75-4bfdff7aae40 req-1be8bda4-db0c-49ca-996d-057e55f03457 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:14.764400 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-b07de2d2-71da-4360-ad75-4bfdff7aae40 req-1be8bda4-db0c-49ca-996d-057e55f03457 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:14.782263 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-b07de2d2-71da-4360-ad75-4bfdff7aae40 req-1be8bda4-db0c-49ca-996d-057e55f03457 service nova] Creating event network-vif-plugged:4bf95a69-e3e3-4ef3-aeeb-8e9c69077969 for instance e80a2c16-520b-48e9-9f83-e643414a8c8e on hv-cinder-84327 May 25 16:10:14.787626 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-b07de2d2-71da-4360-ad75-4bfdff7aae40 req-1be8bda4-db0c-49ca-996d-057e55f03457 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036419 May 25 16:10:14.788281 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 148/295] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:15.253418 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4cd7bb9e-d316-4892-9c67-20ef7a8e951f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:15.254017 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4cd7bb9e-d316-4892-9c67-20ef7a8e951f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:15.255907 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=18 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:15.261651 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb9e-d316-4892-9c67-20ef7a8e951f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:15.262035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb9e-d316-4892-9c67-20ef7a8e951f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:15.262790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb9e-d316-4892-9c67-20ef7a8e951f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:15.263230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb9e-d316-4892-9c67-20ef7a8e951f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:15.408378 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4cd7bb9e-d316-4892-9c67-20ef7a8e951f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:15.419214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4cd7bb9e-d316-4892-9c67-20ef7a8e951f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.169671 May 25 16:10:15.419790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 148/296] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:15 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:15.442655 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e7b4243d-c4ec-4d9a-804f-14cc550372c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:15.443355 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e7b4243d-c4ec-4d9a-804f-14cc550372c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:15.450233 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e7b4243d-c4ec-4d9a-804f-14cc550372c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:15.450684 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e7b4243d-c4ec-4d9a-804f-14cc550372c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:15.451489 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e7b4243d-c4ec-4d9a-804f-14cc550372c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:15.451956 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e7b4243d-c4ec-4d9a-804f-14cc550372c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:15.589238 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e7b4243d-c4ec-4d9a-804f-14cc550372c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:15.597405 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e7b4243d-c4ec-4d9a-804f-14cc550372c9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.160098 May 25 16:10:15.597977 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 149/297] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:15 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:15.729800 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:15.730438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:15.736749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:15.737197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:15.737959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:15.738395 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:15.874391 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:15.876715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=100 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:15.884016 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:15.885610 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:15.886777 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1c7ee12a-7543-4b9e-b10a-c1cb4d3798f2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1745 microversion: 2.20 time: 0.161086 May 25 16:10:15.887338 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 149/298] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:15 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:16.436826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d7302296-ed78-477b-b5a0-ad22779515df tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:16.437657 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d7302296-ed78-477b-b5a0-ad22779515df tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:16.447554 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d7302296-ed78-477b-b5a0-ad22779515df tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:16.448614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d7302296-ed78-477b-b5a0-ad22779515df tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:16.449536 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d7302296-ed78-477b-b5a0-ad22779515df tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:16.449962 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d7302296-ed78-477b-b5a0-ad22779515df tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:16.604807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d7302296-ed78-477b-b5a0-ad22779515df tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:16.616456 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0e28c6fa-7669-4fd1-8c6c-7251d287fd2d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:16.617151 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0e28c6fa-7669-4fd1-8c6c-7251d287fd2d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:16.625074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e28c6fa-7669-4fd1-8c6c-7251d287fd2d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:16.625520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e28c6fa-7669-4fd1-8c6c-7251d287fd2d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:16.627636 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e28c6fa-7669-4fd1-8c6c-7251d287fd2d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:16.628522 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d7302296-ed78-477b-b5a0-ad22779515df tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.194965 May 25 16:10:16.629380 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 150/299] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:16 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:16.634676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e28c6fa-7669-4fd1-8c6c-7251d287fd2d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:16.815023 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0e28c6fa-7669-4fd1-8c6c-7251d287fd2d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:16.822809 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0e28c6fa-7669-4fd1-8c6c-7251d287fd2d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.210571 May 25 16:10:16.823387 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 150/300] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:16 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:10:16.906445 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:16.907226 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:16.917255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:16.917701 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:16.918755 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:16.921854 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:17.087128 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:17.096064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:17.097877 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:17.099413 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7d7b55f7-5502-4ee5-8651-8c06918714de tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1740 microversion: 2.20 time: 0.197907 May 25 16:10:17.100507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 151/301] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:16 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:10:17.646213 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c0981a1b-f9ba-47b5-a1d3-3d0514aa5588 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:17.648108 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c0981a1b-f9ba-47b5-a1d3-3d0514aa5588 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:17.656285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c0981a1b-f9ba-47b5-a1d3-3d0514aa5588 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:17.657000 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c0981a1b-f9ba-47b5-a1d3-3d0514aa5588 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:17.658180 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c0981a1b-f9ba-47b5-a1d3-3d0514aa5588 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:17.658771 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c0981a1b-f9ba-47b5-a1d3-3d0514aa5588 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:17.840243 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fea8d848-d132-49b7-aef1-a4429741a581 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:17.841522 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fea8d848-d132-49b7-aef1-a4429741a581 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:17.847374 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c0981a1b-f9ba-47b5-a1d3-3d0514aa5588 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:17.852582 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fea8d848-d132-49b7-aef1-a4429741a581 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:17.853302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fea8d848-d132-49b7-aef1-a4429741a581 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:17.854257 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fea8d848-d132-49b7-aef1-a4429741a581 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:17.854861 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fea8d848-d132-49b7-aef1-a4429741a581 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:17.856523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c0981a1b-f9ba-47b5-a1d3-3d0514aa5588 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.214326 May 25 16:10:17.865848 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 151/302] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:17 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:18.008442 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fea8d848-d132-49b7-aef1-a4429741a581 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:18.018763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fea8d848-d132-49b7-aef1-a4429741a581 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.182424 May 25 16:10:18.019450 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 152/303] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:17 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:10:18.119209 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:18.120321 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:18.128663 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:18.129422 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:18.130374 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:18.130965 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:18.285967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:18.303969 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:18.306487 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:18.307919 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4b21bc63-8608-4482-bfa2-6fb93dc2c0b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1740 microversion: 2.20 time: 0.193162 May 25 16:10:18.308999 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 152/304] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:18 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:18.873809 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b03ac98b-d1ea-410d-85c8-39ee30362b63 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:18.875218 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b03ac98b-d1ea-410d-85c8-39ee30362b63 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:18.882143 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b03ac98b-d1ea-410d-85c8-39ee30362b63 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:18.882490 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b03ac98b-d1ea-410d-85c8-39ee30362b63 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:18.885687 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b03ac98b-d1ea-410d-85c8-39ee30362b63 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:18.886334 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b03ac98b-d1ea-410d-85c8-39ee30362b63 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:18.895960 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-389f5d5e-4bd6-4b48-92f5-8bb68b37ca9f req-359dc4eb-9916-49de-94cd-70393b888efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b50f41-74ab-479c-898d-14e7396de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "ac4617cf-b210-4ee5-8011-34c4c46ae91a"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:18.909979 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-389f5d5e-4bd6-4b48-92f5-8bb68b37ca9f req-359dc4eb-9916-49de-94cd-70393b888efc service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:18.912069 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-389f5d5e-4bd6-4b48-92f5-8bb68b37ca9f req-359dc4eb-9916-49de-94cd-70393b888efc service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:18.927207 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-389f5d5e-4bd6-4b48-92f5-8bb68b37ca9f req-359dc4eb-9916-49de-94cd-70393b888efc service nova] Creating event network-vif-plugged:ac4617cf-b210-4ee5-8011-34c4c46ae91a for instance 53b50f41-74ab-479c-898d-14e7396de0bb on hv-cinder-84327 May 25 16:10:18.942164 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-389f5d5e-4bd6-4b48-92f5-8bb68b37ca9f req-359dc4eb-9916-49de-94cd-70393b888efc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051275 May 25 16:10:18.943084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 153/305] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:19.037857 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a864a8a8-0848-4c5b-9b49-f61ccc946472 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:19.038576 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a864a8a8-0848-4c5b-9b49-f61ccc946472 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:19.051341 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a864a8a8-0848-4c5b-9b49-f61ccc946472 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:19.052096 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a864a8a8-0848-4c5b-9b49-f61ccc946472 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:19.052897 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b03ac98b-d1ea-410d-85c8-39ee30362b63 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:19.056561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a864a8a8-0848-4c5b-9b49-f61ccc946472 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:19.057261 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a864a8a8-0848-4c5b-9b49-f61ccc946472 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:19.061516 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b03ac98b-d1ea-410d-85c8-39ee30362b63 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.191620 May 25 16:10:19.062696 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 153/306] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:18 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:19.219505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a864a8a8-0848-4c5b-9b49-f61ccc946472 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:19.228001 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a864a8a8-0848-4c5b-9b49-f61ccc946472 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.194691 May 25 16:10:19.229085 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 154/307] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:19 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:19.326691 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:19.327328 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:19.338146 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:19.338586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:19.339382 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:19.340517 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:19.488164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:19.497996 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:19.500496 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:19.502271 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-bc092cb2-9a4b-4263-9b25-875d70ee6079 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1740 microversion: 2.20 time: 0.179571 May 25 16:10:19.503193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 154/308] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:19 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:10:20.078898 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3fe73594-b7a8-4620-b503-6a6a36f85051 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:20.079477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3fe73594-b7a8-4620-b503-6a6a36f85051 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:20.086400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3fe73594-b7a8-4620-b503-6a6a36f85051 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:20.086847 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3fe73594-b7a8-4620-b503-6a6a36f85051 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:20.087602 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3fe73594-b7a8-4620-b503-6a6a36f85051 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:20.088064 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3fe73594-b7a8-4620-b503-6a6a36f85051 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:20.226580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3fe73594-b7a8-4620-b503-6a6a36f85051 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:20.234591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3fe73594-b7a8-4620-b503-6a6a36f85051 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.159792 May 25 16:10:20.235171 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 155/309] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:20 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:20.246064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ec103ab2-263c-4e5e-87e4-83083751cc20 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:20.246670 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ec103ab2-263c-4e5e-87e4-83083751cc20 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:20.254265 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ec103ab2-263c-4e5e-87e4-83083751cc20 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:20.254952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ec103ab2-263c-4e5e-87e4-83083751cc20 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:20.256109 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ec103ab2-263c-4e5e-87e4-83083751cc20 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:20.256765 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ec103ab2-263c-4e5e-87e4-83083751cc20 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:20.394523 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ec103ab2-263c-4e5e-87e4-83083751cc20 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:20.402546 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ec103ab2-263c-4e5e-87e4-83083751cc20 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1367 microversion: 2.1 time: 0.160347 May 25 16:10:20.403097 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 155/310] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:20 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:20.542038 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:20.542685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:20.549172 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:20.549829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:20.550601 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:20.551027 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:20.688353 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:20.701306 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:20.702662 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:20.704015 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a57f5815-b1ee-47d9-a1dc-4d26912d1e15 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1740 microversion: 2.20 time: 0.165681 May 25 16:10:20.708191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 156/311] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:20 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:21.253338 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1b798b27-f997-4212-a04b-2d8dadac03b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:21.254022 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1b798b27-f997-4212-a04b-2d8dadac03b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:21.263475 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1b798b27-f997-4212-a04b-2d8dadac03b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.264105 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1b798b27-f997-4212-a04b-2d8dadac03b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:21.264887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1b798b27-f997-4212-a04b-2d8dadac03b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.265351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1b798b27-f997-4212-a04b-2d8dadac03b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:21.421657 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1b798b27-f997-4212-a04b-2d8dadac03b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:21.431018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8784a4e1-5fcc-41c9-8a5e-e9f4c5495021 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:21.434270 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8784a4e1-5fcc-41c9-8a5e-e9f4c5495021 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:21.439014 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1b798b27-f997-4212-a04b-2d8dadac03b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.189635 May 25 16:10:21.440352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 156/312] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:21 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:21.450689 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8784a4e1-5fcc-41c9-8a5e-e9f4c5495021 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.451375 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8784a4e1-5fcc-41c9-8a5e-e9f4c5495021 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:21.452220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8784a4e1-5fcc-41c9-8a5e-e9f4c5495021 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.452864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8784a4e1-5fcc-41c9-8a5e-e9f4c5495021 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:21.614672 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e0778d06-4d6d-4bf9-b889-b396b4a07ebc tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a84c7fad-8cfe-4804-8cb1-2edfa0148ab1", "device": "/dev/sdb"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:21.616829 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e0778d06-4d6d-4bf9-b889-b396b4a07ebc tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:21.623680 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-8784a4e1-5fcc-41c9-8a5e-e9f4c5495021 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:21.631662 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8784a4e1-5fcc-41c9-8a5e-e9f4c5495021 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1557 microversion: 2.1 time: 0.216666 May 25 16:10:21.643604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 157/313] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:21 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:10:21.643840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0778d06-4d6d-4bf9-b889-b396b4a07ebc tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.643840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0778d06-4d6d-4bf9-b889-b396b4a07ebc tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:21.643840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0778d06-4d6d-4bf9-b889-b396b4a07ebc tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.643840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0778d06-4d6d-4bf9-b889-b396b4a07ebc tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:21.651872 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-eeb45bac-c49d-498b-b6f3-6e23652d5c81 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:21.653878 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-eeb45bac-c49d-498b-b6f3-6e23652d5c81 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:21.660649 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-eeb45bac-c49d-498b-b6f3-6e23652d5c81 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.661329 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-eeb45bac-c49d-498b-b6f3-6e23652d5c81 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:21.662181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-eeb45bac-c49d-498b-b6f3-6e23652d5c81 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.662686 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-eeb45bac-c49d-498b-b6f3-6e23652d5c81 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:21.770211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-eeb45bac-c49d-498b-b6f3-6e23652d5c81 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124917 May 25 16:10:21.777132 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 158/314] 10.222.0.85 () {58 vars in 1274 bytes} [Wed May 25 16:10:21 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:21.778289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:21.778991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:21.787343 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.787939 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:21.788803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:21.789334 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:22.001533 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:22.014562 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:22.016282 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:22.017541 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-09bb0162-364b-41e8-8c53-bd7ff4585fac tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1740 microversion: 2.20 time: 0.244361 May 25 16:10:22.018675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 159/315] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:21 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:22.154040 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e0778d06-4d6d-4bf9-b889-b396b4a07ebc tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "POST /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543234 May 25 16:10:22.155140 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 157/316] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:10:21 2022] POST /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:22.456885 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d842d4be-c3e8-428b-b0cf-6215ef7798e3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:22.458714 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d842d4be-c3e8-428b-b0cf-6215ef7798e3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:22.466135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d842d4be-c3e8-428b-b0cf-6215ef7798e3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:22.466584 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d842d4be-c3e8-428b-b0cf-6215ef7798e3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:22.467371 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d842d4be-c3e8-428b-b0cf-6215ef7798e3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:22.468020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d842d4be-c3e8-428b-b0cf-6215ef7798e3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:22.631174 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d842d4be-c3e8-428b-b0cf-6215ef7798e3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:22.639921 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d842d4be-c3e8-428b-b0cf-6215ef7798e3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.186905 May 25 16:10:22.643155 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 160/317] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:22 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:23.041959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:23.043332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:23.052863 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:23.054574 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:23.055560 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:23.056172 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:23.256841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-7c75b33c-0366-406e-84e5-197444d42005 req-40a7115d-994f-4488-9e20-4ebb9ca25ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b50f41-74ab-479c-898d-14e7396de0bb", "tag": "ac4617cf-b210-4ee5-8011-34c4c46ae91a"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:23.276903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-7c75b33c-0366-406e-84e5-197444d42005 req-40a7115d-994f-4488-9e20-4ebb9ca25ea3 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:23.277242 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-7c75b33c-0366-406e-84e5-197444d42005 req-40a7115d-994f-4488-9e20-4ebb9ca25ea3 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:23.297046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:23.311926 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:23.312541 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-7c75b33c-0366-406e-84e5-197444d42005 req-40a7115d-994f-4488-9e20-4ebb9ca25ea3 service nova] Creating event network-changed:ac4617cf-b210-4ee5-8011-34c4c46ae91a for instance 53b50f41-74ab-479c-898d-14e7396de0bb on hv-cinder-84327 May 25 16:10:23.313312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:23.314505 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e5e2abf0-1d29-4156-b8dd-7514ae5fd225 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1740 microversion: 2.20 time: 0.280968 May 25 16:10:23.315085 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 158/318] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:23 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:23.329143 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-7c75b33c-0366-406e-84e5-197444d42005 req-40a7115d-994f-4488-9e20-4ebb9ca25ea3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076819 May 25 16:10:23.330184 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 161/319] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:23.658841 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d9f3c0f1-8b2e-464d-a6f2-c4f5c9cf516b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:23.659597 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d9f3c0f1-8b2e-464d-a6f2-c4f5c9cf516b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:23.673316 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d9f3c0f1-8b2e-464d-a6f2-c4f5c9cf516b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:23.673773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d9f3c0f1-8b2e-464d-a6f2-c4f5c9cf516b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:23.674970 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d9f3c0f1-8b2e-464d-a6f2-c4f5c9cf516b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:23.675405 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d9f3c0f1-8b2e-464d-a6f2-c4f5c9cf516b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:23.922966 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d9f3c0f1-8b2e-464d-a6f2-c4f5c9cf516b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:23.937283 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d9f3c0f1-8b2e-464d-a6f2-c4f5c9cf516b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.282304 May 25 16:10:23.950365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 159/320] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:23 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:24.334234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:24.335760 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:24.343316 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:24.344505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:24.345595 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:24.346389 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:24.502592 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:24.514673 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:24.516775 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:24.518174 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d93ce489-9da1-44b1-a3c9-7dd28cf2b044 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1740 microversion: 2.20 time: 0.189050 May 25 16:10:24.519273 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 162/321] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:24 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:10:24.954975 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8a72728b-cfd1-4bf7-b5f1-8c901c1476dc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:24.955511 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8a72728b-cfd1-4bf7-b5f1-8c901c1476dc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:24.965546 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8a72728b-cfd1-4bf7-b5f1-8c901c1476dc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:24.966407 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8a72728b-cfd1-4bf7-b5f1-8c901c1476dc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:24.967439 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8a72728b-cfd1-4bf7-b5f1-8c901c1476dc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:24.967975 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8a72728b-cfd1-4bf7-b5f1-8c901c1476dc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:25.119677 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-8a72728b-cfd1-4bf7-b5f1-8c901c1476dc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:25.129029 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8a72728b-cfd1-4bf7-b5f1-8c901c1476dc tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.178187 May 25 16:10:25.129605 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 160/322] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:24 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:25.537559 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:25.538227 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:25.548120 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:25.549066 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:25.550411 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:25.550942 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:25.704306 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:25.714477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:25.716074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:25.717559 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b393a4d0-c8c8-4c0d-9799-fde2f85d26fd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1740 microversion: 2.20 time: 0.184282 May 25 16:10:25.728656 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 163/323] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:25 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:26.148144 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ce87edd9-3666-4e33-b60a-42d366d1252f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:26.148764 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ce87edd9-3666-4e33-b60a-42d366d1252f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:26.155498 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce87edd9-3666-4e33-b60a-42d366d1252f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:26.155971 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce87edd9-3666-4e33-b60a-42d366d1252f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:26.156719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce87edd9-3666-4e33-b60a-42d366d1252f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:26.157354 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce87edd9-3666-4e33-b60a-42d366d1252f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:26.347941 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce87edd9-3666-4e33-b60a-42d366d1252f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:26.357200 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ce87edd9-3666-4e33-b60a-42d366d1252f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.214283 May 25 16:10:26.358197 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 161/324] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:26 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:26.736077 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:26.736682 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:26.743640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:26.744218 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:26.745212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:26.745852 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:26.896869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:26.904968 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:26.906444 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:26.907650 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f6827749-894a-4de4-89b0-623f03cb7104 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1740 microversion: 2.20 time: 0.175473 May 25 16:10:26.908331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 164/325] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:26 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:27.376213 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-360fcf7e-92a7-42b5-931b-ddfe4f7d7c0f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:27.376773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-360fcf7e-92a7-42b5-931b-ddfe4f7d7c0f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:27.383741 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-360fcf7e-92a7-42b5-931b-ddfe4f7d7c0f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:27.384217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-360fcf7e-92a7-42b5-931b-ddfe4f7d7c0f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:27.384981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-360fcf7e-92a7-42b5-931b-ddfe4f7d7c0f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:27.385413 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-360fcf7e-92a7-42b5-931b-ddfe4f7d7c0f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:27.531473 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-360fcf7e-92a7-42b5-931b-ddfe4f7d7c0f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:27.539958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-360fcf7e-92a7-42b5-931b-ddfe4f7d7c0f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.167608 May 25 16:10:27.540525 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 162/326] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:27 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:10:27.926333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:27.926920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:27.933977 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:27.934428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:27.935196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:27.935628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:28.070359 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:28.078957 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:28.080490 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:28.081652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-314318c0-d306-412b-b622-0ad63653cf8a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1722 microversion: 2.20 time: 0.159419 May 25 16:10:28.082214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 165/327] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:27 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:28.559950 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c414e08f-9424-4fc7-bdd8-d61cc4c5b852 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:28.560519 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c414e08f-9424-4fc7-bdd8-d61cc4c5b852 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:28.567010 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c414e08f-9424-4fc7-bdd8-d61cc4c5b852 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:28.567458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c414e08f-9424-4fc7-bdd8-d61cc4c5b852 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:28.568261 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c414e08f-9424-4fc7-bdd8-d61cc4c5b852 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:28.568687 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c414e08f-9424-4fc7-bdd8-d61cc4c5b852 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:28.583777 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:28.705246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c414e08f-9424-4fc7-bdd8-d61cc4c5b852 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:28.713299 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c414e08f-9424-4fc7-bdd8-d61cc4c5b852 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.158084 May 25 16:10:28.713844 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 163/328] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:28 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:29.101362 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:29.102022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:29.109227 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:29.109667 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:29.110427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:29.111103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:29.250905 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:29.259775 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:29.261625 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:29.262792 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-502c7bdc-bae5-402c-a55a-97d3667799e7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1722 microversion: 2.20 time: 0.165877 May 25 16:10:29.263366 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 166/329] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:29 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:29.730079 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-70f035f6-a84c-4cc0-9190-0533b77bf5fa tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:29.730703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-70f035f6-a84c-4cc0-9190-0533b77bf5fa tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:29.737547 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-70f035f6-a84c-4cc0-9190-0533b77bf5fa tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:29.737994 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-70f035f6-a84c-4cc0-9190-0533b77bf5fa tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:29.738760 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-70f035f6-a84c-4cc0-9190-0533b77bf5fa tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:29.739164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-70f035f6-a84c-4cc0-9190-0533b77bf5fa tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:29.870847 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-70f035f6-a84c-4cc0-9190-0533b77bf5fa tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:29.883352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-70f035f6-a84c-4cc0-9190-0533b77bf5fa tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.157015 May 25 16:10:29.884154 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 164/330] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:29 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:30.285103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:30.285703 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:30.292727 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:30.293180 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:30.293947 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:30.295037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:30.428592 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:30.437149 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:30.438644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:30.439946 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f31c5b20-62ff-46cb-9bde-6f6c669cb0ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1722 microversion: 2.20 time: 0.158781 May 25 16:10:30.440539 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 167/331] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:30 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:30.843458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-d77d7d86-0e6d-46cd-9cda-c00d3060b1ac req-9016e5fb-934d-45df-90bc-1a6ec8aeb256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80a2c16-520b-48e9-9f83-e643414a8c8e", "name": "network-vif-unplugged", "status": "completed", "tag": "4bf95a69-e3e3-4ef3-aeeb-8e9c69077969"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:30.852962 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-d77d7d86-0e6d-46cd-9cda-c00d3060b1ac req-9016e5fb-934d-45df-90bc-1a6ec8aeb256 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:30.853454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-d77d7d86-0e6d-46cd-9cda-c00d3060b1ac req-9016e5fb-934d-45df-90bc-1a6ec8aeb256 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:30.865557 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-d77d7d86-0e6d-46cd-9cda-c00d3060b1ac req-9016e5fb-934d-45df-90bc-1a6ec8aeb256 service nova] Creating event network-vif-unplugged:4bf95a69-e3e3-4ef3-aeeb-8e9c69077969 for instance e80a2c16-520b-48e9-9f83-e643414a8c8e on hv-cinder-84327 May 25 16:10:30.870487 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-d77d7d86-0e6d-46cd-9cda-c00d3060b1ac req-9016e5fb-934d-45df-90bc-1a6ec8aeb256 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030791 May 25 16:10:30.871069 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 165/332] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:10:30.901207 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-47f234d3-a383-438d-be22-cc4b8fd95092 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:30.901855 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-47f234d3-a383-438d-be22-cc4b8fd95092 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:30.907903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-47f234d3-a383-438d-be22-cc4b8fd95092 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:30.908339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-47f234d3-a383-438d-be22-cc4b8fd95092 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:30.909097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-47f234d3-a383-438d-be22-cc4b8fd95092 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:30.909518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-47f234d3-a383-438d-be22-cc4b8fd95092 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:30.912241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=100 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:31.041675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-47f234d3-a383-438d-be22-cc4b8fd95092 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:31.049909 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-47f234d3-a383-438d-be22-cc4b8fd95092 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.152859 May 25 16:10:31.050478 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 168/333] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:30 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:31.461902 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:31.462705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:31.470659 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:31.471158 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:31.472054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:31.472515 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:31.631800 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:31.639752 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:31.641267 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:31.642408 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fcc7ccba-3c26-4f43-b4d7-33595331dc7e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1722 microversion: 2.20 time: 0.185387 May 25 16:10:31.642970 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 166/334] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:31 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:32.069324 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d100ba67-be33-4dd9-83df-128f69f3e69b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:32.070135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d100ba67-be33-4dd9-83df-128f69f3e69b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:32.077780 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d100ba67-be33-4dd9-83df-128f69f3e69b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:32.078222 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d100ba67-be33-4dd9-83df-128f69f3e69b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:32.078996 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d100ba67-be33-4dd9-83df-128f69f3e69b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:32.079429 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d100ba67-be33-4dd9-83df-128f69f3e69b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:32.221207 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d100ba67-be33-4dd9-83df-128f69f3e69b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:32.233651 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d100ba67-be33-4dd9-83df-128f69f3e69b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.169585 May 25 16:10:32.234459 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 169/335] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:32 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:32.661642 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:32.662250 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:32.673310 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:32.673759 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:32.674537 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:32.674969 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:32.817815 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:32.826201 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:32.827754 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:32.828995 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-01ed89f8-b010-4bcb-baa2-28ecee323286 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1665 microversion: 2.20 time: 0.171501 May 25 16:10:32.829745 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 167/336] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:32 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:32.847159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-64d2bc29-bd5d-4fda-a3ba-cfd9f0aab56a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b8a5dc-ea47-403e-9aa3-862b4c7aac64"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:32.848325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-64d2bc29-bd5d-4fda-a3ba-cfd9f0aab56a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:32.854675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64d2bc29-bd5d-4fda-a3ba-cfd9f0aab56a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:32.855101 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64d2bc29-bd5d-4fda-a3ba-cfd9f0aab56a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:32.855887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64d2bc29-bd5d-4fda-a3ba-cfd9f0aab56a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:32.856323 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64d2bc29-bd5d-4fda-a3ba-cfd9f0aab56a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:33.181082 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-64d2bc29-bd5d-4fda-a3ba-cfd9f0aab56a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335362 May 25 16:10:33.181082 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 170/337] 10.222.0.85 () {62 vars in 1363 bytes} [Wed May 25 16:10:32 2022] POST /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:10:33.250413 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ddf9b6c9-09aa-4e00-b9f4-5d17a2d46d7c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:33.251031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ddf9b6c9-09aa-4e00-b9f4-5d17a2d46d7c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:33.257201 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddf9b6c9-09aa-4e00-b9f4-5d17a2d46d7c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:33.257691 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddf9b6c9-09aa-4e00-b9f4-5d17a2d46d7c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:33.258456 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddf9b6c9-09aa-4e00-b9f4-5d17a2d46d7c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:33.258890 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddf9b6c9-09aa-4e00-b9f4-5d17a2d46d7c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:33.295351 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0ae4c868-50a4-4c5c-8444-f96be62a3aff tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:33.295944 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0ae4c868-50a4-4c5c-8444-f96be62a3aff tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:33.302206 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ae4c868-50a4-4c5c-8444-f96be62a3aff tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:33.302650 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ae4c868-50a4-4c5c-8444-f96be62a3aff tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:33.303417 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ae4c868-50a4-4c5c-8444-f96be62a3aff tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:33.303929 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ae4c868-50a4-4c5c-8444-f96be62a3aff tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:33.397800 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ddf9b6c9-09aa-4e00-b9f4-5d17a2d46d7c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:33.401173 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0ae4c868-50a4-4c5c-8444-f96be62a3aff tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/action" status: 202 len: 0 microversion: 2.20 time: 0.109764 May 25 16:10:33.401795 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 171/338] 10.222.0.85 () {62 vars in 1318 bytes} [Wed May 25 16:10:33 2022] POST /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:10:33.409515 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ddf9b6c9-09aa-4e00-b9f4-5d17a2d46d7c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.162920 May 25 16:10:33.410241 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 168/339] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:33 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:33.410623 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:33.411917 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:33.418566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:33.418786 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:33.419559 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:33.420036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:33.552209 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:33.561269 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:33.562884 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:33.564120 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6104e5fc-670e-43ed-b6dd-b473ba094ab2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1751 microversion: 2.20 time: 0.158036 May 25 16:10:33.564671 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 172/340] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:33 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:10:34.426758 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a830a5c1-43e8-48cf-87ea-c3f7d3376b56 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:34.427404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a830a5c1-43e8-48cf-87ea-c3f7d3376b56 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:34.440330 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a830a5c1-43e8-48cf-87ea-c3f7d3376b56 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:34.440907 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a830a5c1-43e8-48cf-87ea-c3f7d3376b56 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:34.442113 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a830a5c1-43e8-48cf-87ea-c3f7d3376b56 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:34.442558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a830a5c1-43e8-48cf-87ea-c3f7d3376b56 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:34.582862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:34.583459 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:34.584814 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a830a5c1-43e8-48cf-87ea-c3f7d3376b56 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:34.590118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:34.590655 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:34.591326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:34.591754 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:34.593099 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a830a5c1-43e8-48cf-87ea-c3f7d3376b56 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.170647 May 25 16:10:34.593669 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 169/341] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:34 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:34.723857 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:34.732491 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:34.733953 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:34.735093 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f6f04b8f-f1bc-45c8-8c0c-c8eeac70c370 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1751 microversion: 2.20 time: 0.156247 May 25 16:10:34.735641 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 173/342] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:34 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:35.613966 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-acfe145f-4eab-4636-bf39-220729b76f3e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:35.614975 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-acfe145f-4eab-4636-bf39-220729b76f3e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:35.626133 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-acfe145f-4eab-4636-bf39-220729b76f3e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:35.626884 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-acfe145f-4eab-4636-bf39-220729b76f3e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:35.628214 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-acfe145f-4eab-4636-bf39-220729b76f3e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:35.628945 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-acfe145f-4eab-4636-bf39-220729b76f3e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:35.752870 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:35.754044 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:35.760907 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:35.761605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:35.762356 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:35.762971 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:35.768170 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-acfe145f-4eab-4636-bf39-220729b76f3e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:35.776890 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-acfe145f-4eab-4636-bf39-220729b76f3e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.169541 May 25 16:10:35.777577 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 170/343] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:35 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:35.888904 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:35.897943 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:35.899427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:35.900629 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5ee09125-0aa4-46a7-85e6-71f8a333aed0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1751 microversion: 2.20 time: 0.151651 May 25 16:10:35.901179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 174/344] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:35 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:36.800168 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e06494f5-5c88-457e-93a9-093a660a724a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:36.801968 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e06494f5-5c88-457e-93a9-093a660a724a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:36.817912 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e06494f5-5c88-457e-93a9-093a660a724a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:36.818844 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e06494f5-5c88-457e-93a9-093a660a724a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:36.820417 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e06494f5-5c88-457e-93a9-093a660a724a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:36.821303 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e06494f5-5c88-457e-93a9-093a660a724a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:36.924436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:36.926964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:36.934861 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:36.935408 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:36.936390 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:36.936887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:36.972241 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e06494f5-5c88-457e-93a9-093a660a724a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:36.981447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e06494f5-5c88-457e-93a9-093a660a724a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.190372 May 25 16:10:36.982023 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 171/345] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:36 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:37.085157 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:37.093556 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:37.095019 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:37.096178 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d4b75418-8ad9-452d-98d0-aaf7de69bca7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1753 microversion: 2.20 time: 0.180727 May 25 16:10:37.096749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 175/346] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:36 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:10:38.003020 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d35922ba-f6c5-43a5-b48f-c01d361e3b04 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:38.004025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d35922ba-f6c5-43a5-b48f-c01d361e3b04 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:38.014422 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d35922ba-f6c5-43a5-b48f-c01d361e3b04 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:38.014873 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d35922ba-f6c5-43a5-b48f-c01d361e3b04 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:38.015647 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d35922ba-f6c5-43a5-b48f-c01d361e3b04 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:38.016122 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d35922ba-f6c5-43a5-b48f-c01d361e3b04 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:38.114710 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:38.115220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:38.122134 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:38.122589 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:38.123353 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:38.123784 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:38.144965 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d35922ba-f6c5-43a5-b48f-c01d361e3b04 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:38.153652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d35922ba-f6c5-43a5-b48f-c01d361e3b04 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1701 microversion: 2.1 time: 0.157567 May 25 16:10:38.154239 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 172/347] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:37 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:38.170319 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5417b285-6d56-462a-ad71-a711fa4604a1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:38.176443 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5417b285-6d56-462a-ad71-a711fa4604a1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:38.176892 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5417b285-6d56-462a-ad71-a711fa4604a1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:38.198277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5417b285-6d56-462a-ad71-a711fa4604a1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Going to try to start instance {{(pid=117763) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 16:10:38.242045 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5417b285-6d56-462a-ad71-a711fa4604a1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/action" status: 202 len: 0 microversion: 2.1 time: 0.075404 May 25 16:10:38.242661 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 173/348] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:10:38 2022] POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:10:38.251682 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-50f971e8-512b-4e6f-8d30-4c01ab66f99f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:38.252416 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-50f971e8-512b-4e6f-8d30-4c01ab66f99f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:38.258385 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:38.258712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-50f971e8-512b-4e6f-8d30-4c01ab66f99f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:38.259163 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-50f971e8-512b-4e6f-8d30-4c01ab66f99f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:38.260210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-50f971e8-512b-4e6f-8d30-4c01ab66f99f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:38.261164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-50f971e8-512b-4e6f-8d30-4c01ab66f99f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:38.267049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:38.268572 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:38.269746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9d79eb05-37eb-4ca2-9610-c30395e87ac4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.159123 May 25 16:10:38.270324 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 176/349] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:38 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:38.393654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-50f971e8-512b-4e6f-8d30-4c01ab66f99f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:38.403037 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-50f971e8-512b-4e6f-8d30-4c01ab66f99f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1710 microversion: 2.1 time: 0.155882 May 25 16:10:38.403652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 174/350] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:38 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:39.293241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:39.294166 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:39.301500 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:39.301958 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:39.302738 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:39.303177 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:39.421041 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e4a9bdef-aa6b-4cd3-91d7-2b17af052f2c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:39.421603 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e4a9bdef-aa6b-4cd3-91d7-2b17af052f2c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:39.429057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e4a9bdef-aa6b-4cd3-91d7-2b17af052f2c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:39.429306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e4a9bdef-aa6b-4cd3-91d7-2b17af052f2c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:39.430084 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e4a9bdef-aa6b-4cd3-91d7-2b17af052f2c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:39.430520 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e4a9bdef-aa6b-4cd3-91d7-2b17af052f2c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:39.431481 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:39.440423 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:39.441930 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:39.443089 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-14de67c2-9262-4c0f-acf1-fdfef8c6f863 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.156763 May 25 16:10:39.443651 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 177/351] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:39 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:39.573202 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e4a9bdef-aa6b-4cd3-91d7-2b17af052f2c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:39.582017 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e4a9bdef-aa6b-4cd3-91d7-2b17af052f2c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1710 microversion: 2.1 time: 0.165243 May 25 16:10:39.582594 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 175/352] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:39 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1710 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:40.466013 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:40.467010 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:40.474492 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:40.474935 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:40.475695 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:40.476167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:40.603083 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f4833d69-49b3-4052-9eff-36b0d89579f0 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:40.603719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f4833d69-49b3-4052-9eff-36b0d89579f0 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:40.610635 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f4833d69-49b3-4052-9eff-36b0d89579f0 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:40.611087 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f4833d69-49b3-4052-9eff-36b0d89579f0 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:40.611865 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f4833d69-49b3-4052-9eff-36b0d89579f0 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:40.612332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f4833d69-49b3-4052-9eff-36b0d89579f0 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:40.751217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f4833d69-49b3-4052-9eff-36b0d89579f0 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:40.761501 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f4833d69-49b3-4052-9eff-36b0d89579f0 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1710 microversion: 2.1 time: 0.162199 May 25 16:10:40.762112 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 176/353] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:40 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:10:40.835012 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:40.843667 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:40.845214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:40.846373 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e5b7d319-ab19-4ff4-b12a-f45aaec52b65 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.387076 May 25 16:10:40.846893 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 178/354] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:40 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:41.779870 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ef3f90a5-5693-4bae-ae48-c9195dd947fe tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:41.780595 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ef3f90a5-5693-4bae-ae48-c9195dd947fe tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:41.784255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=72 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:41.788574 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ef3f90a5-5693-4bae-ae48-c9195dd947fe tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:41.788937 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ef3f90a5-5693-4bae-ae48-c9195dd947fe tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:41.789822 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ef3f90a5-5693-4bae-ae48-c9195dd947fe tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:41.790259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ef3f90a5-5693-4bae-ae48-c9195dd947fe tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:41.865159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:41.865737 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:41.868421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=78 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:41.874300 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:41.874753 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:41.875522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:41.875994 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:42.004985 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:42.014002 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:42.015502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:42.016700 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0fa700d7-954d-4673-8de4-f00c566c6f47 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.155550 May 25 16:10:42.017301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 179/355] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:41 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:10:42.324101 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ef3f90a5-5693-4bae-ae48-c9195dd947fe tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:42.333168 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ef3f90a5-5693-4bae-ae48-c9195dd947fe tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1710 microversion: 2.1 time: 0.557943 May 25 16:10:42.333822 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 177/356] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:41 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1710 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:43.040615 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:43.041458 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:43.050083 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:43.050531 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:43.051297 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:43.051765 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:43.191913 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:43.200557 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:43.202142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:43.203291 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-62e76823-c39a-46ce-ace5-eb45f5128649 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.169746 May 25 16:10:43.203857 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 180/357] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:43 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:43.355595 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0b794fa8-56b5-4f22-a3a6-ff7a502539ee tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:43.356693 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0b794fa8-56b5-4f22-a3a6-ff7a502539ee tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:43.367729 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0b794fa8-56b5-4f22-a3a6-ff7a502539ee tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:43.368534 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0b794fa8-56b5-4f22-a3a6-ff7a502539ee tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:43.369790 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0b794fa8-56b5-4f22-a3a6-ff7a502539ee tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:43.370514 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0b794fa8-56b5-4f22-a3a6-ff7a502539ee tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:43.511455 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0b794fa8-56b5-4f22-a3a6-ff7a502539ee tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:43.524427 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0b794fa8-56b5-4f22-a3a6-ff7a502539ee tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1710 microversion: 2.1 time: 0.175127 May 25 16:10:43.525167 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 178/358] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:43 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:44.225612 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:44.226652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:44.237649 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:44.238399 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:44.239631 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:44.240471 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:44.244729 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:44.375115 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:44.384240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:44.385725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:44.386950 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-685586a1-f298-4023-a18f-e3a5a81b9028 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.168238 May 25 16:10:44.387493 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 181/359] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:44 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:44.548015 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d5b9707e-a01d-4c2f-af2c-10a467ff83c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:44.548925 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d5b9707e-a01d-4c2f-af2c-10a467ff83c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:44.560636 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d5b9707e-a01d-4c2f-af2c-10a467ff83c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:44.561369 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d5b9707e-a01d-4c2f-af2c-10a467ff83c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:44.562611 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d5b9707e-a01d-4c2f-af2c-10a467ff83c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:44.563324 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d5b9707e-a01d-4c2f-af2c-10a467ff83c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:44.701285 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d5b9707e-a01d-4c2f-af2c-10a467ff83c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:44.703606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:44.717638 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d5b9707e-a01d-4c2f-af2c-10a467ff83c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1710 microversion: 2.1 time: 0.176325 May 25 16:10:44.718210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 179/360] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:44 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1710 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:45.406533 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:45.407175 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:45.414391 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:45.414839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:45.415640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:45.416100 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:45.568170 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:45.577193 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:45.578858 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:45.580059 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1d16424d-2650-4535-8029-13650b9cad6e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.177761 May 25 16:10:45.580624 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 182/361] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:45 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:45.734491 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-00fa6b62-75e6-41b4-a9fb-d50035d67bf8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:45.735405 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-00fa6b62-75e6-41b4-a9fb-d50035d67bf8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:45.744704 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-00fa6b62-75e6-41b4-a9fb-d50035d67bf8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:45.745170 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-00fa6b62-75e6-41b4-a9fb-d50035d67bf8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:45.745937 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-00fa6b62-75e6-41b4-a9fb-d50035d67bf8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:45.746362 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-00fa6b62-75e6-41b4-a9fb-d50035d67bf8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:46.035394 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-00fa6b62-75e6-41b4-a9fb-d50035d67bf8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:46.044879 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-00fa6b62-75e6-41b4-a9fb-d50035d67bf8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1710 microversion: 2.1 time: 0.314131 May 25 16:10:46.056587 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 180/362] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:45 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1710 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:46.598262 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:46.599591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:46.607035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:46.607959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:46.608982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:46.609565 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:46.750824 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:46.769658 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:46.771579 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:46.772774 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-11af230c-ef31-4b4b-98d9-9ee4673a7f9c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.178625 May 25 16:10:46.773341 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 183/363] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:46 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:47.073340 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-db35b128-89ad-468e-b113-116e399e82a4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:47.074483 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-db35b128-89ad-468e-b113-116e399e82a4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:47.082715 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-db35b128-89ad-468e-b113-116e399e82a4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:47.083174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-db35b128-89ad-468e-b113-116e399e82a4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:47.084003 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-db35b128-89ad-468e-b113-116e399e82a4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:47.084535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-db35b128-89ad-468e-b113-116e399e82a4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:47.281844 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-db35b128-89ad-468e-b113-116e399e82a4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:47.293427 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-db35b128-89ad-468e-b113-116e399e82a4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1714 microversion: 2.1 time: 0.224310 May 25 16:10:47.294764 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 181/364] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:47 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1714 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:47.792529 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:47.793156 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:47.800359 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:47.800812 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:47.801594 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:47.801989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:47.980560 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:47.990388 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:47.992073 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:47.993659 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cee29c35-f113-4675-88f6-b279bb57d952 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.205611 May 25 16:10:47.994330 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 184/365] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:47 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:49.012462 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:49.013093 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:49.019728 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:49.020545 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:49.021299 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:49.021724 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:49.171274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:49.181941 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:49.183998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:49.185431 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5ecbf165-cd55-4865-9952-59117dfb9c71 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.177096 May 25 16:10:49.196242 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 182/366] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:49 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:49.376347 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9385df2a-a4ed-48db-9bb0-442413b3f3e6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:49.376899 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9385df2a-a4ed-48db-9bb0-442413b3f3e6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:49.383368 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9385df2a-a4ed-48db-9bb0-442413b3f3e6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:49.383807 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9385df2a-a4ed-48db-9bb0-442413b3f3e6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:49.384580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9385df2a-a4ed-48db-9bb0-442413b3f3e6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:49.385003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9385df2a-a4ed-48db-9bb0-442413b3f3e6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:49.522618 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-9385df2a-a4ed-48db-9bb0-442413b3f3e6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lazy-loading 'services' on Instance uuid 8253004a-eb87-4982-963c-d977a69b1508 {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:10:49.651426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9385df2a-a4ed-48db-9bb0-442413b3f3e6 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508/os-volume_attachments/a84c7fad-8cfe-4804-8cb1-2edfa0148ab1" status: 202 len: 0 microversion: 2.1 time: 0.278890 May 25 16:10:49.664582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 185/367] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:10:49 2022] DELETE /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508/os-volume_attachments/a84c7fad-8cfe-4804-8cb1-2edfa0148ab1 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:10:50.205977 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:50.206682 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:50.217439 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:50.217894 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:50.218701 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:50.219177 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:50.393176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:50.402160 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:50.403659 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:50.404844 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2d4ad173-b8f1-45ab-9f0e-434e14e28303 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.203639 May 25 16:10:50.405401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 183/368] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:50 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:51.423315 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:51.424042 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:51.431359 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:51.431847 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:51.432632 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:51.433092 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:51.586047 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:51.596084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:51.597713 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:51.598980 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e0a4e12a-a3ff-4bd1-b55d-e53973dd5be1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.180193 May 25 16:10:51.599669 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 186/369] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:51 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:52.469255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1042093877", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:10:52.534038 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] validate_networks() for None {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:10:52.617642 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:52.619897 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:52.627278 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:52.627726 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:52.628554 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:52.629318 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:52.768222 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:52.777827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:52.779542 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:52.789348 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c3877d5d-f732-4caa-b292-b62f39f043c0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.174136 May 25 16:10:52.791488 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 187/370] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:52 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:52.829241 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:10:52.830114 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:10:52.830540 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:10:52.831163 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:10:52.832073 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:10:52.843928 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:52.844367 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:52.845157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:52.845588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:52.864170 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Getting quotas for project 2e01367e6f0a4bb9abf67383702ae6c2. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:10:52.868127 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Getting quotas for user 86a27ac3f2ba45469d8b9a871e4df159 and project 2e01367e6f0a4bb9abf67383702ae6c2. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:10:52.881853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:10:52.892025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:10:52.942714 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-86e13988-34b8-40e4-ad82-45ee35a89eac tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.477402 May 25 16:10:52.943970 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 184/371] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:10:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:10:52.954936 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c612bbd7-ac9a-4694-952b-2e051765fb66 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:52.955883 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c612bbd7-ac9a-4694-952b-2e051765fb66 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:53.031986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c612bbd7-ac9a-4694-952b-2e051765fb66 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:53.039693 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c612bbd7-ac9a-4694-952b-2e051765fb66 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1215 microversion: 2.1 time: 0.089631 May 25 16:10:53.040391 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 188/372] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:52 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:53.809251 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:53.809882 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:53.816835 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:53.817283 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:53.818054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:53.818489 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:53.971259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:53.981218 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:53.983191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:53.984628 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-740648ce-d5c6-4642-bf18-dd51b1d653e1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.179515 May 25 16:10:53.985264 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 185/373] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:53 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:54.057126 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-19e62e1a-59c6-4065-9862-67ef95d319e1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:54.057725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-19e62e1a-59c6-4065-9862-67ef95d319e1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:54.064301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-19e62e1a-59c6-4065-9862-67ef95d319e1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:54.064739 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-19e62e1a-59c6-4065-9862-67ef95d319e1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:54.065488 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-19e62e1a-59c6-4065-9862-67ef95d319e1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:54.065918 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-19e62e1a-59c6-4065-9862-67ef95d319e1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:54.133673 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-19e62e1a-59c6-4065-9862-67ef95d319e1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:54.142631 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-19e62e1a-59c6-4065-9862-67ef95d319e1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1219 microversion: 2.1 time: 0.089300 May 25 16:10:54.147686 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 189/374] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:54 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:55.002985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:55.003574 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:55.011093 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:55.011544 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:55.012345 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:55.012864 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:55.150781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:55.159284 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6a17e0c3-10eb-4114-9745-2afa662cb8a1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:55.161485 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6a17e0c3-10eb-4114-9745-2afa662cb8a1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:55.171493 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:55.175228 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6a17e0c3-10eb-4114-9745-2afa662cb8a1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:55.177372 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:55.177704 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6a17e0c3-10eb-4114-9745-2afa662cb8a1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:55.178702 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6a17e0c3-10eb-4114-9745-2afa662cb8a1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:55.179338 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6a17e0c3-10eb-4114-9745-2afa662cb8a1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:55.184770 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b6e811ac-3eee-4074-9d45-565bad504b5a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.185515 May 25 16:10:55.185688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 186/375] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:54 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:55.254038 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6a17e0c3-10eb-4114-9745-2afa662cb8a1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:55.261846 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6a17e0c3-10eb-4114-9745-2afa662cb8a1 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1219 microversion: 2.1 time: 0.106521 May 25 16:10:55.262413 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 190/376] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:55 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:56.210501 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:56.212633 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:56.229901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:56.230348 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:56.231136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:56.231574 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:56.283283 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-91316e0e-29fb-41a7-86d2-14d8acac143c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:56.284664 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-91316e0e-29fb-41a7-86d2-14d8acac143c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:56.292045 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-91316e0e-29fb-41a7-86d2-14d8acac143c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:56.293276 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-91316e0e-29fb-41a7-86d2-14d8acac143c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:56.294268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-91316e0e-29fb-41a7-86d2-14d8acac143c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:56.294761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-91316e0e-29fb-41a7-86d2-14d8acac143c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:56.361825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-91316e0e-29fb-41a7-86d2-14d8acac143c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:56.369463 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-91316e0e-29fb-41a7-86d2-14d8acac143c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1219 microversion: 2.1 time: 0.094329 May 25 16:10:56.370047 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 191/377] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:56 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:56.389345 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:56.398462 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:56.399969 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:56.401274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1ebaf743-5ba2-4f32-9e4e-68f0d510b88c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.198857 May 25 16:10:56.402045 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 187/378] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:56 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:57.388561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6ec94848-f0b8-4c15-9ddb-8947b7457eae tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:57.389413 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6ec94848-f0b8-4c15-9ddb-8947b7457eae tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:57.397936 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6ec94848-f0b8-4c15-9ddb-8947b7457eae tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:57.398387 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6ec94848-f0b8-4c15-9ddb-8947b7457eae tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:57.399154 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6ec94848-f0b8-4c15-9ddb-8947b7457eae tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:57.399588 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6ec94848-f0b8-4c15-9ddb-8947b7457eae tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:57.420674 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:57.421255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:57.428416 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:57.429181 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:57.430301 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:57.430952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:57.473576 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6ec94848-f0b8-4c15-9ddb-8947b7457eae tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:57.481405 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6ec94848-f0b8-4c15-9ddb-8947b7457eae tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1219 microversion: 2.1 time: 0.098015 May 25 16:10:57.482199 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 192/379] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:57 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:57.569861 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:57.581024 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:57.582598 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:57.583764 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d8002df6-27ab-4278-bac3-3c363ff13e96 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.167112 May 25 16:10:57.584351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 188/380] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:57 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:58.502627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ad3d58f0-b7df-46d3-b5e0-89151ada88a8 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:58.503656 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ad3d58f0-b7df-46d3-b5e0-89151ada88a8 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:58.511328 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ad3d58f0-b7df-46d3-b5e0-89151ada88a8 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:58.511846 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ad3d58f0-b7df-46d3-b5e0-89151ada88a8 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:58.512708 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ad3d58f0-b7df-46d3-b5e0-89151ada88a8 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:58.513187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ad3d58f0-b7df-46d3-b5e0-89151ada88a8 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:58.586899 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ad3d58f0-b7df-46d3-b5e0-89151ada88a8 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:58.598438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ad3d58f0-b7df-46d3-b5e0-89151ada88a8 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1211 microversion: 2.1 time: 0.102129 May 25 16:10:58.599342 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 193/381] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:58 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:58.605012 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:58.605732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:58.615469 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:58.615944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:58.616698 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:58.617133 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:58.766263 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:58.776530 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:58.778096 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:58.779303 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a740a629-699f-4b32-99b9-fee3eb2f21b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.179799 May 25 16:10:58.780167 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 189/382] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:58 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:10:59.621007 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ce8f8c6d-0914-406e-a9f9-676bccdabc38 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:59.621871 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ce8f8c6d-0914-406e-a9f9-676bccdabc38 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:59.631203 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ce8f8c6d-0914-406e-a9f9-676bccdabc38 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:59.632316 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ce8f8c6d-0914-406e-a9f9-676bccdabc38 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:59.633379 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ce8f8c6d-0914-406e-a9f9-676bccdabc38 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:59.634009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ce8f8c6d-0914-406e-a9f9-676bccdabc38 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:59.698448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ce8f8c6d-0914-406e-a9f9-676bccdabc38 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:59.706561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ce8f8c6d-0914-406e-a9f9-676bccdabc38 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1267 microversion: 2.1 time: 0.091070 May 25 16:10:59.707112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 194/383] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:10:59 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:10:59.802223 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:10:59.803031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:10:59.814041 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:59.814780 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:59.816128 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:10:59.816562 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:10:59.983217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:59.991582 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:59.993122 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:10:59.994295 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ab409680-c310-4798-9119-2df590448700 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.198912 May 25 16:10:59.994835 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 190/384] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:10:59 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:00.361663 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-70e9e47d-bb8a-492c-8ebe-10ee86e2db15 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:00.362382 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-70e9e47d-bb8a-492c-8ebe-10ee86e2db15 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:00.368572 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-70e9e47d-bb8a-492c-8ebe-10ee86e2db15 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:00.369022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-70e9e47d-bb8a-492c-8ebe-10ee86e2db15 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:00.369789 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-70e9e47d-bb8a-492c-8ebe-10ee86e2db15 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:00.370238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-70e9e47d-bb8a-492c-8ebe-10ee86e2db15 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:00.398819 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-70e9e47d-bb8a-492c-8ebe-10ee86e2db15 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:11:00.483603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-70e9e47d-bb8a-492c-8ebe-10ee86e2db15 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 204 len: 0 microversion: 2.1 time: 0.125569 May 25 16:11:00.484483 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 195/385] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:11:00 2022] DELETE /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:11:00.492834 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-961e52f2-c6cc-42c7-8e77-857b1bec6c4a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:00.493722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-961e52f2-c6cc-42c7-8e77-857b1bec6c4a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:00.499837 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-961e52f2-c6cc-42c7-8e77-857b1bec6c4a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:00.500339 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-961e52f2-c6cc-42c7-8e77-857b1bec6c4a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:00.501108 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-961e52f2-c6cc-42c7-8e77-857b1bec6c4a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:00.501537 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-961e52f2-c6cc-42c7-8e77-857b1bec6c4a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:00.684052 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-961e52f2-c6cc-42c7-8e77-857b1bec6c4a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:00.694391 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-961e52f2-c6cc-42c7-8e77-857b1bec6c4a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1514 microversion: 2.1 time: 0.205365 May 25 16:11:00.694988 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 191/386] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:00 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:00.723464 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a4edd856-2b52-44e8-a316-6621392eeee4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:00.724150 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a4edd856-2b52-44e8-a316-6621392eeee4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:00.730871 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a4edd856-2b52-44e8-a316-6621392eeee4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:00.731311 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a4edd856-2b52-44e8-a316-6621392eeee4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:00.732111 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a4edd856-2b52-44e8-a316-6621392eeee4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:00.732548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a4edd856-2b52-44e8-a316-6621392eeee4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:00.747457 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:00.811260 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a4edd856-2b52-44e8-a316-6621392eeee4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:00.819215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a4edd856-2b52-44e8-a316-6621392eeee4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1273 microversion: 2.1 time: 0.100165 May 25 16:11:00.820021 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 196/387] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:00 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:01.015083 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:01.015700 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:01.024279 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:01.024732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:01.025497 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:01.025927 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:01.232644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:01.241410 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:01.243132 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:01.244323 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1019df3b-59cf-4fdc-a68c-3bea94e8fbf9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.235020 May 25 16:11:01.244874 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 192/388] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:01 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:01.716733 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-fd48d384-0c0a-4e5d-a33c-69fc061cf17b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:01.717737 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-fd48d384-0c0a-4e5d-a33c-69fc061cf17b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:01.728804 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fd48d384-0c0a-4e5d-a33c-69fc061cf17b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:01.729806 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fd48d384-0c0a-4e5d-a33c-69fc061cf17b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:01.730995 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fd48d384-0c0a-4e5d-a33c-69fc061cf17b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:01.731712 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fd48d384-0c0a-4e5d-a33c-69fc061cf17b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:01.836651 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-205121de-acf2-4541-9c96-3554281aa65b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:01.837266 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-205121de-acf2-4541-9c96-3554281aa65b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:01.843930 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-205121de-acf2-4541-9c96-3554281aa65b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:01.844369 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-205121de-acf2-4541-9c96-3554281aa65b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:01.845143 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-205121de-acf2-4541-9c96-3554281aa65b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:01.845580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-205121de-acf2-4541-9c96-3554281aa65b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:01.881991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-fd48d384-0c0a-4e5d-a33c-69fc061cf17b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:01.889892 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-fd48d384-0c0a-4e5d-a33c-69fc061cf17b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1514 microversion: 2.1 time: 0.179748 May 25 16:11:01.890473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 197/389] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:01 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:01.973657 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-205121de-acf2-4541-9c96-3554281aa65b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:01.981330 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-205121de-acf2-4541-9c96-3554281aa65b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.148711 May 25 16:11:01.981897 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 193/390] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:01 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:02.266953 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:02.267761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:02.275800 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:02.276279 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:02.277029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:02.277934 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:02.409525 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:02.423353 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:02.426236 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:02.427660 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a0f6a463-128e-440e-90d8-76dd667a49b2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.167452 May 25 16:11:02.428222 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 198/391] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:02 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:02.904904 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:02.906427 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:02.910175 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-97d39093-9798-4822-b9ef-4104fe583339 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:02.910791 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-97d39093-9798-4822-b9ef-4104fe583339 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:02.918701 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97d39093-9798-4822-b9ef-4104fe583339 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:02.919151 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97d39093-9798-4822-b9ef-4104fe583339 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:02.919955 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97d39093-9798-4822-b9ef-4104fe583339 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:02.920373 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97d39093-9798-4822-b9ef-4104fe583339 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:02.998392 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a3ddad3a-07be-48fe-b86b-2a9b4d64945a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:02.999016 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a3ddad3a-07be-48fe-b86b-2a9b4d64945a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:03.005903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a3ddad3a-07be-48fe-b86b-2a9b4d64945a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:03.006355 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a3ddad3a-07be-48fe-b86b-2a9b4d64945a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:03.007125 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a3ddad3a-07be-48fe-b86b-2a9b4d64945a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:03.007558 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a3ddad3a-07be-48fe-b86b-2a9b4d64945a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:03.037459 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:03.140156 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a3ddad3a-07be-48fe-b86b-2a9b4d64945a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:03.148438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a3ddad3a-07be-48fe-b86b-2a9b4d64945a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.154049 May 25 16:11:03.149255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 199/392] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:02 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:11:03.159331 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-97d39093-9798-4822-b9ef-4104fe583339 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:03.166919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-97d39093-9798-4822-b9ef-4104fe583339 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1514 microversion: 2.1 time: 0.263319 May 25 16:11:03.167596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 194/393] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:02 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:03.445946 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:03.446464 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:03.453470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:03.453895 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:03.454676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:03.455146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:03.602698 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:03.603933 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-22f6f62a-aeeb-4b05-82b1-1e25dee5cb1c req-53df3783-d49d-47cb-b87f-80a076c94b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d824a79e-fb2e-40e7-a2c7-0a567705304a", "tag": "47c88dfa-6147-49a7-bfed-724799dd578a"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:03.620600 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:03.625204 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-22f6f62a-aeeb-4b05-82b1-1e25dee5cb1c req-53df3783-d49d-47cb-b87f-80a076c94b1a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:03.625628 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-22f6f62a-aeeb-4b05-82b1-1e25dee5cb1c req-53df3783-d49d-47cb-b87f-80a076c94b1a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:03.626840 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:03.628249 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-23cf0097-bbb3-432f-9f45-a2c9c160c9f1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.186874 May 25 16:11:03.630510 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 200/394] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:03 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:03.666219 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-22f6f62a-aeeb-4b05-82b1-1e25dee5cb1c req-53df3783-d49d-47cb-b87f-80a076c94b1a service nova] Creating event network-changed:47c88dfa-6147-49a7-bfed-724799dd578a for instance d824a79e-fb2e-40e7-a2c7-0a567705304a on hv-cinder-84327 May 25 16:11:03.672654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-22f6f62a-aeeb-4b05-82b1-1e25dee5cb1c req-53df3783-d49d-47cb-b87f-80a076c94b1a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072976 May 25 16:11:03.673601 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 195/395] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:04.165815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e3f37c6a-5283-4089-93e0-b77a85f51225 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:04.166363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e3f37c6a-5283-4089-93e0-b77a85f51225 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:04.172938 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e3f37c6a-5283-4089-93e0-b77a85f51225 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:04.173367 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e3f37c6a-5283-4089-93e0-b77a85f51225 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:04.174123 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e3f37c6a-5283-4089-93e0-b77a85f51225 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:04.174548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e3f37c6a-5283-4089-93e0-b77a85f51225 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:04.184826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b7ba9d68-6163-4512-940f-22c3891da8b1 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:04.186867 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b7ba9d68-6163-4512-940f-22c3891da8b1 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:04.193895 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b7ba9d68-6163-4512-940f-22c3891da8b1 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:04.194341 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b7ba9d68-6163-4512-940f-22c3891da8b1 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:04.195118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b7ba9d68-6163-4512-940f-22c3891da8b1 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:04.195558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b7ba9d68-6163-4512-940f-22c3891da8b1 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:04.314453 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e3f37c6a-5283-4089-93e0-b77a85f51225 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:04.322487 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e3f37c6a-5283-4089-93e0-b77a85f51225 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.160590 May 25 16:11:04.331876 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 201/396] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:04 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:04.436276 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b7ba9d68-6163-4512-940f-22c3891da8b1 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:04.446081 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b7ba9d68-6163-4512-940f-22c3891da8b1 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1514 microversion: 2.1 time: 0.265524 May 25 16:11:04.446661 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 196/397] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:04 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:04.647308 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:04.647938 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:04.654470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:04.654918 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:04.655675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:04.656137 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:04.792861 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:04.804423 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:04.806095 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:04.807307 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-62f5e923-a4a0-44be-937a-1d1d81bed7a0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.164278 May 25 16:11:04.807908 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 202/398] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:04 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:05.340669 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d911b0ca-e4df-4a2f-8a88-7654a2e5fa1e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:05.341342 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d911b0ca-e4df-4a2f-8a88-7654a2e5fa1e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:05.349080 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d911b0ca-e4df-4a2f-8a88-7654a2e5fa1e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:05.349578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d911b0ca-e4df-4a2f-8a88-7654a2e5fa1e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:05.350424 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d911b0ca-e4df-4a2f-8a88-7654a2e5fa1e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:05.350903 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d911b0ca-e4df-4a2f-8a88-7654a2e5fa1e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:05.463230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-83b95514-4cb3-40fa-93f6-5515219118f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:05.463899 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-83b95514-4cb3-40fa-93f6-5515219118f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:05.470534 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83b95514-4cb3-40fa-93f6-5515219118f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:05.470987 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83b95514-4cb3-40fa-93f6-5515219118f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:05.471754 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83b95514-4cb3-40fa-93f6-5515219118f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:05.472218 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83b95514-4cb3-40fa-93f6-5515219118f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:05.493759 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d911b0ca-e4df-4a2f-8a88-7654a2e5fa1e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:05.496194 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=100 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:05.502678 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d911b0ca-e4df-4a2f-8a88-7654a2e5fa1e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.166531 May 25 16:11:05.503258 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 197/399] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:05 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:05.536015 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-83b95514-4cb3-40fa-93f6-5515219118f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:05.543754 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-83b95514-4cb3-40fa-93f6-5515219118f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1304 microversion: 2.1 time: 0.084742 May 25 16:11:05.544383 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 203/400] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:05 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:05.692102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-77f8b00e-b434-495a-865e-2731004a53d0 req-fe06af87-a218-4d41-897a-35479ddf9304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8253004a-eb87-4982-963c-d977a69b1508", "name": "network-vif-deleted", "tag": "5aa2665a-f27b-4727-a1dc-4d9a102547d8"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:05.700722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-77f8b00e-b434-495a-865e-2731004a53d0 req-fe06af87-a218-4d41-897a-35479ddf9304 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:05.701171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-77f8b00e-b434-495a-865e-2731004a53d0 req-fe06af87-a218-4d41-897a-35479ddf9304 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:05.712175 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-77f8b00e-b434-495a-865e-2731004a53d0 req-fe06af87-a218-4d41-897a-35479ddf9304 service nova] Creating event network-vif-deleted:5aa2665a-f27b-4727-a1dc-4d9a102547d8 for instance 8253004a-eb87-4982-963c-d977a69b1508 on hv-cinder-84327 May 25 16:11:05.717023 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-77f8b00e-b434-495a-865e-2731004a53d0 req-fe06af87-a218-4d41-897a-35479ddf9304 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028929 May 25 16:11:05.717588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 198/401] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:05.826171 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:05.827040 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:05.836036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:05.836808 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:05.837920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:05.838714 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:05.976033 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:05.984566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:05.986046 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:05.987188 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-93159317-09d3-4f9b-89e8-ce330f5c9805 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.165522 May 25 16:11:05.987746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 204/402] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:05 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:06.525013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f38d90f2-8bf5-4799-8067-03d6c04f94fe tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:06.526023 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f38d90f2-8bf5-4799-8067-03d6c04f94fe tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:06.536500 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f38d90f2-8bf5-4799-8067-03d6c04f94fe tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:06.536945 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f38d90f2-8bf5-4799-8067-03d6c04f94fe tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:06.537701 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f38d90f2-8bf5-4799-8067-03d6c04f94fe tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:06.538130 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f38d90f2-8bf5-4799-8067-03d6c04f94fe tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:06.561467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6dedb5ef-6c12-4074-9f88-6d49590b942b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:06.562173 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6dedb5ef-6c12-4074-9f88-6d49590b942b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:06.569024 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6dedb5ef-6c12-4074-9f88-6d49590b942b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:06.569481 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6dedb5ef-6c12-4074-9f88-6d49590b942b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:06.570373 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6dedb5ef-6c12-4074-9f88-6d49590b942b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:06.570815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6dedb5ef-6c12-4074-9f88-6d49590b942b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:06.632513 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6dedb5ef-6c12-4074-9f88-6d49590b942b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:06.640159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6dedb5ef-6c12-4074-9f88-6d49590b942b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1304 microversion: 2.1 time: 0.082608 May 25 16:11:06.640721 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 205/403] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:06 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1304 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:06.671480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f38d90f2-8bf5-4799-8067-03d6c04f94fe tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:06.682469 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f38d90f2-8bf5-4799-8067-03d6c04f94fe tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.165737 May 25 16:11:06.683132 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 199/404] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:06 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:07.006324 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:07.007182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:07.013487 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:07.013926 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:07.014710 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:07.015135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:07.147840 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:07.157364 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:07.158894 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:07.160130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-67d7275c-a64b-4935-8b96-e786ddf3071d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.158117 May 25 16:11:07.160696 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 206/405] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:07 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:07.659319 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:07.660671 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:07.668061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:07.668628 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:07.669478 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:07.670000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:07.705013 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3a70c96b-ab71-455a-9441-9f9d39a3eea4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:07.705746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3a70c96b-ab71-455a-9441-9f9d39a3eea4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:07.710560 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:07.711008 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:07.711586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lazy-loading 'fault' on Instance uuid 8253004a-eb87-4982-963c-d977a69b1508 {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:11:07.713347 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a70c96b-ab71-455a-9441-9f9d39a3eea4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:07.713878 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a70c96b-ab71-455a-9441-9f9d39a3eea4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:07.714642 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a70c96b-ab71-455a-9441-9f9d39a3eea4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:07.715160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a70c96b-ab71-455a-9441-9f9d39a3eea4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:07.777255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:07.787328 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-297f3a2e-d062-4ade-94e7-69cf0be632df tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 200 len: 1309 microversion: 2.1 time: 0.133257 May 25 16:11:07.788239 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 200/406] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:07 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 1309 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:07.874914 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3a70c96b-ab71-455a-9441-9f9d39a3eea4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:07.882774 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3a70c96b-ab71-455a-9441-9f9d39a3eea4 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.183490 May 25 16:11:07.883337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 207/407] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:07 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:08.179494 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:08.180014 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:08.186254 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:08.186705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:08.187502 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:08.187965 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:08.321247 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:08.329980 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:08.331468 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:08.332646 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5f398d06-d8e9-41c1-b20a-10ac388c8ff7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.157510 May 25 16:11:08.333170 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 201/408] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:08 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:08.804923 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:08.805527 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 8253004a-eb87-4982-963c-d977a69b1508] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:08.816730 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:08.817297 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:08.818142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:08.818808 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:08.832999 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] HTTP exception thrown: Instance 8253004a-eb87-4982-963c-d977a69b1508 could not be found. May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Request method failure captured: May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 HTTP/1.1 May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlTGssKPr76j-PnXmiYtdKsCkPT8WpQHtYuFWLp1s9G4v6rlCVhu5fAQ7Pdu6sKXWHypfs3J8jo9VpWJGI38RnAyoTeL4EBAGxgOp0DpoVO8rjRF85fZ6xnSTdxkIGoKcEJz6_4uYKUdpsEomR3KGCWSRTIqycyXVPnCaBh55c7HlO8 May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: b32433ec45854be380fcd9a9671a4ce5 May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesSnapshotTestJSON-166935950 May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:11:08.834586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b32433ec45854be380fcd9a9671a4ce5", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b32433ec45854be380fcd9a9671a4ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b32433ec45854be380fcd9a9671a4ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b32433ec45854be380fcd9a9671a4ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesSnapshotTestJSON-166935950 May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: b32433ec45854be380fcd9a9671a4ce5 May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-166935950 May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesSnapshotTestJSON-166935950-project May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 2b909d4c7d9b45b29f995268f8fac987 May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesSnapshotTestJSON-166935950-project May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 8253004a-eb87-4982-963c-d977a69b1508 could not be found. May 25 16:11:08.836129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '8253004a-eb87-4982-963c-d977a69b1508'} May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8253004a-eb87-4982-963c-d977a69b1508 could not be found. May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:11:08.837031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8253004a-eb87-4982-963c-d977a69b1508 could not be found. May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8253004a-eb87-4982-963c-d977a69b1508 could not be found. May 25 16:11:08.838462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:08.839792 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Returning 404 to user: Instance 8253004a-eb87-4982-963c-d977a69b1508 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:11:08.839792 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-066dc456-45f7-4c67-8795-8e1f287b7131 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508" status: 404 len: 111 microversion: 2.1 time: 0.034991 May 25 16:11:08.839792 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 208/409] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:08 2022] GET /compute/v2.1/servers/8253004a-eb87-4982-963c-d977a69b1508 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:11:08.899181 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1edb1a8c-47bb-47be-a182-16c0f1fcbe9e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:08.899804 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1edb1a8c-47bb-47be-a182-16c0f1fcbe9e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:08.906698 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1edb1a8c-47bb-47be-a182-16c0f1fcbe9e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:08.907152 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1edb1a8c-47bb-47be-a182-16c0f1fcbe9e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:08.907947 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1edb1a8c-47bb-47be-a182-16c0f1fcbe9e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:08.908385 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1edb1a8c-47bb-47be-a182-16c0f1fcbe9e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:09.073099 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1edb1a8c-47bb-47be-a182-16c0f1fcbe9e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:09.081054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1edb1a8c-47bb-47be-a182-16c0f1fcbe9e tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.185956 May 25 16:11:09.081649 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 202/410] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:08 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:09.197814 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-3858aa1e-3716-4e37-a555-f97cc9c94e43 req-f4ef9963-d795-4a33-9d38-d88ff7f17dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80a2c16-520b-48e9-9f83-e643414a8c8e", "name": "network-vif-plugged", "status": "completed", "tag": "4bf95a69-e3e3-4ef3-aeeb-8e9c69077969"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:09.208645 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-3858aa1e-3716-4e37-a555-f97cc9c94e43 req-f4ef9963-d795-4a33-9d38-d88ff7f17dfd service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:09.209142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-3858aa1e-3716-4e37-a555-f97cc9c94e43 req-f4ef9963-d795-4a33-9d38-d88ff7f17dfd service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:09.221228 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-3858aa1e-3716-4e37-a555-f97cc9c94e43 req-f4ef9963-d795-4a33-9d38-d88ff7f17dfd service nova] Creating event network-vif-plugged:4bf95a69-e3e3-4ef3-aeeb-8e9c69077969 for instance e80a2c16-520b-48e9-9f83-e643414a8c8e on hv-cinder-84327 May 25 16:11:09.226643 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-3858aa1e-3716-4e37-a555-f97cc9c94e43 req-f4ef9963-d795-4a33-9d38-d88ff7f17dfd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033163 May 25 16:11:09.227222 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 209/411] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:11:09.351094 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:09.351730 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:09.358445 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:09.358885 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:09.359641 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:09.360100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:09.490899 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:09.499440 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:09.500965 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:09.502128 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-59808879-a825-475f-8be8-98a4d5a1da6b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.155281 May 25 16:11:09.502682 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 203/412] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:09 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:10.098832 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ff443716-be6f-4f9b-8930-369f5d452682 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:10.099532 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ff443716-be6f-4f9b-8930-369f5d452682 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:10.106805 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ff443716-be6f-4f9b-8930-369f5d452682 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:10.107243 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ff443716-be6f-4f9b-8930-369f5d452682 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:10.108069 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ff443716-be6f-4f9b-8930-369f5d452682 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:10.108512 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ff443716-be6f-4f9b-8930-369f5d452682 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:10.255749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ff443716-be6f-4f9b-8930-369f5d452682 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:10.264270 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ff443716-be6f-4f9b-8930-369f5d452682 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.169742 May 25 16:11:10.264840 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 210/413] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:10 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:10.525417 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:10.526234 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:10.532528 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:10.533055 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:10.533810 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:10.534232 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:10.674307 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:10.683204 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:10.684748 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:10.685910 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1d9fcebd-3990-4e1b-b027-d0aad4bf4ae3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.168153 May 25 16:11:10.686475 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 204/414] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:10 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:11.291163 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a61a1f5c-1a23-4dbe-b25a-38d09d9a98f7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:11.292380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a61a1f5c-1a23-4dbe-b25a-38d09d9a98f7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:11.303638 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a61a1f5c-1a23-4dbe-b25a-38d09d9a98f7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:11.304331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a61a1f5c-1a23-4dbe-b25a-38d09d9a98f7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:11.305104 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a61a1f5c-1a23-4dbe-b25a-38d09d9a98f7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:11.305552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a61a1f5c-1a23-4dbe-b25a-38d09d9a98f7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:11.438275 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a61a1f5c-1a23-4dbe-b25a-38d09d9a98f7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:11.447635 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a61a1f5c-1a23-4dbe-b25a-38d09d9a98f7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.163712 May 25 16:11:11.448273 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 211/415] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:11 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:11.708514 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:11.709551 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:11.720587 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:11.721336 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:11.722586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:11.723309 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:11.857631 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:11.866647 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:11.868233 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:11.869422 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-80a37610-dae3-4352-99b9-9b27025b8df9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.167649 May 25 16:11:11.869988 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 205/416] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:11 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:12.468962 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1f731b4b-38ab-476c-b1c7-cde11b08ebf7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:12.470114 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1f731b4b-38ab-476c-b1c7-cde11b08ebf7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:12.474083 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:12.481331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f731b4b-38ab-476c-b1c7-cde11b08ebf7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:12.481779 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f731b4b-38ab-476c-b1c7-cde11b08ebf7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:12.482555 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f731b4b-38ab-476c-b1c7-cde11b08ebf7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:12.482992 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f731b4b-38ab-476c-b1c7-cde11b08ebf7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:12.611782 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1f731b4b-38ab-476c-b1c7-cde11b08ebf7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:12.619763 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1f731b4b-38ab-476c-b1c7-cde11b08ebf7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.157462 May 25 16:11:12.620672 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 212/417] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:12 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:12.633825 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-8e8b58c1-f63d-4545-b932-7b5cae33a92a req-cd7e64a1-2fd5-460d-b849-9416db46ae80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d824a79e-fb2e-40e7-a2c7-0a567705304a", "name": "network-vif-plugged", "status": "completed", "tag": "47c88dfa-6147-49a7-bfed-724799dd578a"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:12.637905 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:12.645123 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-8e8b58c1-f63d-4545-b932-7b5cae33a92a req-cd7e64a1-2fd5-460d-b849-9416db46ae80 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:12.645606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-8e8b58c1-f63d-4545-b932-7b5cae33a92a req-cd7e64a1-2fd5-460d-b849-9416db46ae80 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:12.657019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-8e8b58c1-f63d-4545-b932-7b5cae33a92a req-cd7e64a1-2fd5-460d-b849-9416db46ae80 service nova] Creating event network-vif-plugged:47c88dfa-6147-49a7-bfed-724799dd578a for instance d824a79e-fb2e-40e7-a2c7-0a567705304a on hv-cinder-84327 May 25 16:11:12.662186 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-8e8b58c1-f63d-4545-b932-7b5cae33a92a req-cd7e64a1-2fd5-460d-b849-9416db46ae80 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041224 May 25 16:11:12.662922 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 206/418] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:11:12.888185 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:12.888788 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:12.895627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:12.896108 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:12.896902 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:12.897332 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:13.032431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:13.044076 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:13.045592 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:13.046753 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f5392b35-997f-4e89-9c2b-bb61fdee0bd5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.162771 May 25 16:11:13.047314 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 213/419] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:12 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:13.638094 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-318cff36-4568-43ff-80ce-d952aa254cc9 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:13.638901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-318cff36-4568-43ff-80ce-d952aa254cc9 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:13.646875 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-318cff36-4568-43ff-80ce-d952aa254cc9 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:13.647572 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-318cff36-4568-43ff-80ce-d952aa254cc9 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:13.648805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-318cff36-4568-43ff-80ce-d952aa254cc9 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:13.649429 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-318cff36-4568-43ff-80ce-d952aa254cc9 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:13.789204 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-318cff36-4568-43ff-80ce-d952aa254cc9 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:13.796926 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-318cff36-4568-43ff-80ce-d952aa254cc9 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.163781 May 25 16:11:13.797660 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 207/420] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:13 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:14.070046 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:14.070652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:14.077559 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:14.078072 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:14.078916 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:14.079352 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:14.096075 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=100 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:14.216619 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:14.227451 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:14.228973 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:14.230244 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9ff0ad92-9cf3-4743-aebb-a653f23a5547 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.166740 May 25 16:11:14.230804 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 214/421] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:14 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:14.818327 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7d92e739-6466-4b19-a688-2df61b8c283a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:14.819279 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7d92e739-6466-4b19-a688-2df61b8c283a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:14.827354 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d92e739-6466-4b19-a688-2df61b8c283a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:14.827803 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d92e739-6466-4b19-a688-2df61b8c283a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:14.828611 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d92e739-6466-4b19-a688-2df61b8c283a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:14.829048 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7d92e739-6466-4b19-a688-2df61b8c283a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:14.979703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7d92e739-6466-4b19-a688-2df61b8c283a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:14.987415 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7d92e739-6466-4b19-a688-2df61b8c283a tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.175869 May 25 16:11:14.988023 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 208/422] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:14 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:15.253278 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:15.254263 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:15.265593 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:15.266335 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:15.267600 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:15.268709 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:15.403730 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:15.416253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:15.417755 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:15.418909 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-14c2f2ca-1332-4268-861c-84a040c36df1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.172312 May 25 16:11:15.419470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 215/423] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:15 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:16.008273 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-10623725-ec38-4185-9105-b9a727cc36bc tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:16.009208 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-10623725-ec38-4185-9105-b9a727cc36bc tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:16.020732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-10623725-ec38-4185-9105-b9a727cc36bc tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:16.021492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-10623725-ec38-4185-9105-b9a727cc36bc tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:16.023215 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-10623725-ec38-4185-9105-b9a727cc36bc tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:16.023992 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-10623725-ec38-4185-9105-b9a727cc36bc tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:16.160597 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-10623725-ec38-4185-9105-b9a727cc36bc tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:16.168246 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-10623725-ec38-4185-9105-b9a727cc36bc tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.166523 May 25 16:11:16.168813 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 209/424] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:16 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:16.437731 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:16.438302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:16.445587 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:16.446031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:16.446785 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:16.447221 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:16.587433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:16.596300 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:16.597810 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:16.598971 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d6012664-b010-4d8e-ae90-f6e4e7fbce85 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.165301 May 25 16:11:16.599588 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 216/425] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:16 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:17.188817 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0e3a5bb2-3084-4f7d-b35b-ebaef6eeef9b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:17.189490 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0e3a5bb2-3084-4f7d-b35b-ebaef6eeef9b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:17.197358 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0e3a5bb2-3084-4f7d-b35b-ebaef6eeef9b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:17.197854 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0e3a5bb2-3084-4f7d-b35b-ebaef6eeef9b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:17.198703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0e3a5bb2-3084-4f7d-b35b-ebaef6eeef9b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:17.199189 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0e3a5bb2-3084-4f7d-b35b-ebaef6eeef9b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:17.337852 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0e3a5bb2-3084-4f7d-b35b-ebaef6eeef9b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:17.345957 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0e3a5bb2-3084-4f7d-b35b-ebaef6eeef9b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.162832 May 25 16:11:17.346526 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 210/426] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:17 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:17.621597 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:17.622535 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:17.633552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:17.634877 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:17.635153 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:17.636979 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:17.767968 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:17.778154 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:17.779632 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:17.780842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f08edd63-f5e3-4ee2-9e48-d57b6559fc32 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1809 microversion: 2.20 time: 0.165868 May 25 16:11:17.781413 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 217/427] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:17 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:11:18.372111 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8b969624-f5f4-432c-b0cc-2a9b47683f3b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:18.373112 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8b969624-f5f4-432c-b0cc-2a9b47683f3b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:18.384215 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8b969624-f5f4-432c-b0cc-2a9b47683f3b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:18.384686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8b969624-f5f4-432c-b0cc-2a9b47683f3b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:18.385446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8b969624-f5f4-432c-b0cc-2a9b47683f3b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:18.385883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8b969624-f5f4-432c-b0cc-2a9b47683f3b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:18.520662 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-8b969624-f5f4-432c-b0cc-2a9b47683f3b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:18.533122 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8b969624-f5f4-432c-b0cc-2a9b47683f3b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1315 microversion: 2.1 time: 0.167337 May 25 16:11:18.533910 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 211/428] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:18 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:18.793078 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-451889379", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "networks": [{"uuid": "454d2741-79ec-4e94-82d2-47867e0733f2"}]}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:18.798681 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:18.799294 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:18.805513 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:18.806031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:18.806815 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:18.807245 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:18.851391 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.network.neutron [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] validate_networks() for [('454d2741-79ec-4e94-82d2-47867e0733f2', None, None, None, None, None)] {{(pid=117764) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:11:18.940011 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:18.948676 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:18.950184 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:18.951644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0c431104-49cc-41e3-9de6-352d84ad0f4f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1796 microversion: 2.20 time: 0.157158 May 25 16:11:18.952234 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 212/429] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:11:18 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:11:19.193346 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Flavor limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:11:19.193768 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Image limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:11:19.194240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Flavor pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:11:19.194681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Image pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:11:19.195091 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:11:19.204627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:19.205075 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:19.205876 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:19.206315 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:19.223432 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Getting quotas for project b32433ec45854be380fcd9a9671a4ce5. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:11:19.227483 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Getting quotas for user 2b909d4c7d9b45b29f995268f8fac987 and project b32433ec45854be380fcd9a9671a4ce5. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:11:19.239056 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Going to run 1 instances... {{(pid=117764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:11:19.241341 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:11:19.293831 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-40fd59b9-2a77-4420-ab29-ce7f2df4c5d9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504697 May 25 16:11:19.294746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 218/430] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:11:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:11:19.306016 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9a9c3cb7-12be-4efe-b18f-e87be77da6c4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:19.306660 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9a9c3cb7-12be-4efe-b18f-e87be77da6c4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:19.363623 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9a9c3cb7-12be-4efe-b18f-e87be77da6c4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:19.370289 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9a9c3cb7-12be-4efe-b18f-e87be77da6c4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1218 microversion: 2.1 time: 0.069465 May 25 16:11:19.370928 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 213/431] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:19 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:19.553056 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-48a04498-3ec9-440f-9b1f-dd04703e8321 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:19.553703 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-48a04498-3ec9-440f-9b1f-dd04703e8321 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:19.561289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-48a04498-3ec9-440f-9b1f-dd04703e8321 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:19.561733 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-48a04498-3ec9-440f-9b1f-dd04703e8321 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:19.562497 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-48a04498-3ec9-440f-9b1f-dd04703e8321 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:19.562938 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-48a04498-3ec9-440f-9b1f-dd04703e8321 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:19.699719 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-48a04498-3ec9-440f-9b1f-dd04703e8321 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:19.708827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-48a04498-3ec9-440f-9b1f-dd04703e8321 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1465 microversion: 2.1 time: 0.158872 May 25 16:11:19.709561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 219/432] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:19 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:19.748734 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-106b3886-55d4-4801-8938-8bffce0ae2b7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:19.749278 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-106b3886-55d4-4801-8938-8bffce0ae2b7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:19.755919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-106b3886-55d4-4801-8938-8bffce0ae2b7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:19.756368 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-106b3886-55d4-4801-8938-8bffce0ae2b7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:19.757147 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-106b3886-55d4-4801-8938-8bffce0ae2b7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:19.757579 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-106b3886-55d4-4801-8938-8bffce0ae2b7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:19.784204 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-106b3886-55d4-4801-8938-8bffce0ae2b7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Going to try to terminate instance {{(pid=117763) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:11:19.838374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:19.877531 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-106b3886-55d4-4801-8938-8bffce0ae2b7 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 204 len: 0 microversion: 2.1 time: 0.132456 May 25 16:11:19.878165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 214/433] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:11:19 2022] DELETE /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 16:11:19.886660 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d93fb3b4-fe44-4812-9b30-7b98c0d1321f tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:19.887273 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d93fb3b4-fe44-4812-9b30-7b98c0d1321f tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:19.894514 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d93fb3b4-fe44-4812-9b30-7b98c0d1321f tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:19.894997 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d93fb3b4-fe44-4812-9b30-7b98c0d1321f tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:19.895758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d93fb3b4-fe44-4812-9b30-7b98c0d1321f tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:19.896253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d93fb3b4-fe44-4812-9b30-7b98c0d1321f tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:20.037227 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d93fb3b4-fe44-4812-9b30-7b98c0d1321f tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:20.045354 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d93fb3b4-fe44-4812-9b30-7b98c0d1321f tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1471 microversion: 2.1 time: 0.162608 May 25 16:11:20.045926 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 220/434] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:19 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:20.391593 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4de0257a-3ad3-477a-a666-cfc4275db480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:20.392760 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4de0257a-3ad3-477a-a666-cfc4275db480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:20.402503 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4de0257a-3ad3-477a-a666-cfc4275db480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:20.402948 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4de0257a-3ad3-477a-a666-cfc4275db480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:20.403709 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4de0257a-3ad3-477a-a666-cfc4275db480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:20.404167 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4de0257a-3ad3-477a-a666-cfc4275db480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:20.475718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4de0257a-3ad3-477a-a666-cfc4275db480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:20.483540 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4de0257a-3ad3-477a-a666-cfc4275db480 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1270 microversion: 2.1 time: 0.099040 May 25 16:11:20.484144 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 215/435] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:20 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:21.066969 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2cdff9ad-7b81-4882-bbbd-8b73a098f877 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:21.068026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2cdff9ad-7b81-4882-bbbd-8b73a098f877 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:21.079194 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2cdff9ad-7b81-4882-bbbd-8b73a098f877 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:21.079990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2cdff9ad-7b81-4882-bbbd-8b73a098f877 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:21.081268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2cdff9ad-7b81-4882-bbbd-8b73a098f877 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:21.081993 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2cdff9ad-7b81-4882-bbbd-8b73a098f877 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:21.216852 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2cdff9ad-7b81-4882-bbbd-8b73a098f877 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:21.224946 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2cdff9ad-7b81-4882-bbbd-8b73a098f877 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1471 microversion: 2.1 time: 0.164442 May 25 16:11:21.225489 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 221/436] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:21 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:21.467224 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c5c4f919-ef35-4bf0-9748-ac7d5b4d8616 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bd8486c-19f1-45ce-a4d3-1dccc8828c60"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:21.468722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c5c4f919-ef35-4bf0-9748-ac7d5b4d8616 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:21.478342 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5c4f919-ef35-4bf0-9748-ac7d5b4d8616 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:21.479074 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5c4f919-ef35-4bf0-9748-ac7d5b4d8616 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:21.479855 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5c4f919-ef35-4bf0-9748-ac7d5b4d8616 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:21.480312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5c4f919-ef35-4bf0-9748-ac7d5b4d8616 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:21.499785 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-594df854-9c47-499c-b7a5-503e1fc942eb tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:21.500456 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-594df854-9c47-499c-b7a5-503e1fc942eb tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:21.506825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-594df854-9c47-499c-b7a5-503e1fc942eb tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:21.507274 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-594df854-9c47-499c-b7a5-503e1fc942eb tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:21.508145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-594df854-9c47-499c-b7a5-503e1fc942eb tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:21.508521 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-594df854-9c47-499c-b7a5-503e1fc942eb tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:21.572706 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-594df854-9c47-499c-b7a5-503e1fc942eb tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:21.580884 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-594df854-9c47-499c-b7a5-503e1fc942eb tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1270 microversion: 2.1 time: 0.085044 May 25 16:11:21.581454 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 222/437] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:21 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:22.124648 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c5c4f919-ef35-4bf0-9748-ac7d5b4d8616 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663150 May 25 16:11:22.131102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 216/438] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:11:21 2022] POST /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:22.242583 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1b96c468-aa3a-4311-be47-7fe36bee591b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:22.243296 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1b96c468-aa3a-4311-be47-7fe36bee591b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:22.254530 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1b96c468-aa3a-4311-be47-7fe36bee591b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:22.254974 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1b96c468-aa3a-4311-be47-7fe36bee591b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:22.255753 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1b96c468-aa3a-4311-be47-7fe36bee591b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:22.256240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1b96c468-aa3a-4311-be47-7fe36bee591b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:22.418792 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1b96c468-aa3a-4311-be47-7fe36bee591b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:22.427115 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1b96c468-aa3a-4311-be47-7fe36bee591b tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1471 microversion: 2.1 time: 0.188508 May 25 16:11:22.427699 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 223/439] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:22 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:22.599153 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-da63cff1-be93-4f24-aaa1-5eecf9e188c8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:22.599853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-da63cff1-be93-4f24-aaa1-5eecf9e188c8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:22.607238 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da63cff1-be93-4f24-aaa1-5eecf9e188c8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:22.607617 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da63cff1-be93-4f24-aaa1-5eecf9e188c8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:22.608429 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da63cff1-be93-4f24-aaa1-5eecf9e188c8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:22.608863 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da63cff1-be93-4f24-aaa1-5eecf9e188c8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:22.696921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-da63cff1-be93-4f24-aaa1-5eecf9e188c8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:22.705988 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-da63cff1-be93-4f24-aaa1-5eecf9e188c8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1276 microversion: 2.1 time: 0.111620 May 25 16:11:22.716176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 217/440] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:22 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:22.842853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-f193540a-e2a0-424f-80e6-246614556090 req-fcc25d9e-8132-44f2-917a-81fec1b61b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d824a79e-fb2e-40e7-a2c7-0a567705304a", "name": "network-vif-deleted", "tag": "47c88dfa-6147-49a7-bfed-724799dd578a"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:22.853563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-f193540a-e2a0-424f-80e6-246614556090 req-fcc25d9e-8132-44f2-917a-81fec1b61b98 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:22.854066 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-f193540a-e2a0-424f-80e6-246614556090 req-fcc25d9e-8132-44f2-917a-81fec1b61b98 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:22.866283 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-f193540a-e2a0-424f-80e6-246614556090 req-fcc25d9e-8132-44f2-917a-81fec1b61b98 service nova] Creating event network-vif-deleted:47c88dfa-6147-49a7-bfed-724799dd578a for instance d824a79e-fb2e-40e7-a2c7-0a567705304a on hv-cinder-84327 May 25 16:11:22.872521 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-f193540a-e2a0-424f-80e6-246614556090 req-fcc25d9e-8132-44f2-917a-81fec1b61b98 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033903 May 25 16:11:22.873406 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 224/441] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:23.449219 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:23.450218 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:23.461709 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:23.462134 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:23.463502 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:23.464913 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:23.496737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:23.497193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:23.497650 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lazy-loading 'fault' on Instance uuid d824a79e-fb2e-40e7-a2c7-0a567705304a {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:11:23.562215 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a27ac3f2ba45469d8b9a871e4df159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e01367e6f0a4bb9abf67383702ae6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:23.571944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0845a298-97bf-4c41-84b8-2fb0154b168c tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 200 len: 1305 microversion: 2.1 time: 0.129246 May 25 16:11:23.573271 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 218/442] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:23 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:23.725824 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b1c9bd68-c71a-431a-9055-473b08a3bd57 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:23.726445 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b1c9bd68-c71a-431a-9055-473b08a3bd57 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:23.732887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1c9bd68-c71a-431a-9055-473b08a3bd57 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:23.733378 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1c9bd68-c71a-431a-9055-473b08a3bd57 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:23.734257 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1c9bd68-c71a-431a-9055-473b08a3bd57 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:23.734818 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1c9bd68-c71a-431a-9055-473b08a3bd57 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:23.864772 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b1c9bd68-c71a-431a-9055-473b08a3bd57 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:23.872590 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b1c9bd68-c71a-431a-9055-473b08a3bd57 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1318 microversion: 2.1 time: 0.151659 May 25 16:11:23.873136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 225/443] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:23 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:24.589562 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:24.590210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] [instance: d824a79e-fb2e-40e7-a2c7-0a567705304a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:24.596868 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:24.597316 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:24.598077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:24.598517 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:24.612195 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] HTTP exception thrown: Instance d824a79e-fb2e-40e7-a2c7-0a567705304a could not be found. May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Request method failure captured: May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a HTTP/1.1 May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlUK_6LzucvVWmYsyq4mZEQC4VIOb6Cz_c9O_tVr9ptoro6djmlQMNGQqXh9lBZVXfsohWETVopGgmc8hH_Jfp5OtozH2Ya7Wj8zBuLxnKhL_u4X7elxcKltwLDzGTcVuYzj-g6KOLBBwXsCDiRnL3DUHKtqfnuY4aUM_AMK1xWE5zk May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 2e01367e6f0a4bb9abf67383702ae6c2 May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-VolumesNegativeTest-991800485 May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:11:24.614744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2e01367e6f0a4bb9abf67383702ae6c2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2e01367e6f0a4bb9abf67383702ae6c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2e01367e6f0a4bb9abf67383702ae6c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2e01367e6f0a4bb9abf67383702ae6c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-VolumesNegativeTest-991800485 May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 2e01367e6f0a4bb9abf67383702ae6c2 May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-VolumesNegativeTest-991800485 May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-VolumesNegativeTest-991800485-project May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 86a27ac3f2ba45469d8b9a871e4df159 May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-VolumesNegativeTest-991800485-project May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance d824a79e-fb2e-40e7-a2c7-0a567705304a could not be found. May 25 16:11:24.616460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': 'd824a79e-fb2e-40e7-a2c7-0a567705304a'} May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d824a79e-fb2e-40e7-a2c7-0a567705304a could not be found. May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:11:24.617454 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d824a79e-fb2e-40e7-a2c7-0a567705304a could not be found. May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d824a79e-fb2e-40e7-a2c7-0a567705304a could not be found. May 25 16:11:24.618686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:24.619872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] Returning 404 to user: Instance d824a79e-fb2e-40e7-a2c7-0a567705304a could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:11:24.619872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8d8ca8e5-f0fe-447f-b2e1-0c67c3cec799 tempest-VolumesNegativeTest-991800485 tempest-VolumesNegativeTest-991800485-project] 10.222.0.85 "GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a" status: 404 len: 111 microversion: 2.1 time: 0.030657 May 25 16:11:24.619872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 219/444] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:24 2022] GET /compute/v2.1/servers/d824a79e-fb2e-40e7-a2c7-0a567705304a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:11:24.889862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-28beb368-2704-46ab-98cb-33cae13f7c26 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:24.890551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-28beb368-2704-46ab-98cb-33cae13f7c26 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:24.897402 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28beb368-2704-46ab-98cb-33cae13f7c26 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:24.897931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28beb368-2704-46ab-98cb-33cae13f7c26 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:24.898775 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28beb368-2704-46ab-98cb-33cae13f7c26 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:24.899300 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28beb368-2704-46ab-98cb-33cae13f7c26 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:24.911749 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-9b6e3b54-0776-4069-9025-b5f41e0dff47 req-29d5bb83-e351-4983-a7c5-6d530cc96005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6bf66-982e-4358-adf4-d5ad0c0cd061", "tag": "aae7561e-069c-49cd-b130-6900676f3d8c"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:24.922670 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-9b6e3b54-0776-4069-9025-b5f41e0dff47 req-29d5bb83-e351-4983-a7c5-6d530cc96005 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:24.923122 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-9b6e3b54-0776-4069-9025-b5f41e0dff47 req-29d5bb83-e351-4983-a7c5-6d530cc96005 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:24.934657 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-9b6e3b54-0776-4069-9025-b5f41e0dff47 req-29d5bb83-e351-4983-a7c5-6d530cc96005 service nova] Creating event network-changed:aae7561e-069c-49cd-b130-6900676f3d8c for instance 46b6bf66-982e-4358-adf4-d5ad0c0cd061 on hv-cinder-84327 May 25 16:11:24.939803 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-9b6e3b54-0776-4069-9025-b5f41e0dff47 req-29d5bb83-e351-4983-a7c5-6d530cc96005 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032489 May 25 16:11:24.940416 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 220/445] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:25.041289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-28beb368-2704-46ab-98cb-33cae13f7c26 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:25.049837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-28beb368-2704-46ab-98cb-33cae13f7c26 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1318 microversion: 2.1 time: 0.164038 May 25 16:11:25.050437 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 226/446] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:24 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:26.068027 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-dbcd501d-be24-4856-b381-44ab5771b0e3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:26.068808 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-dbcd501d-be24-4856-b381-44ab5771b0e3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:26.076728 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dbcd501d-be24-4856-b381-44ab5771b0e3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:26.077179 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dbcd501d-be24-4856-b381-44ab5771b0e3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:26.077961 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dbcd501d-be24-4856-b381-44ab5771b0e3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:26.078398 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dbcd501d-be24-4856-b381-44ab5771b0e3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:26.276174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-dbcd501d-be24-4856-b381-44ab5771b0e3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:26.285998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-dbcd501d-be24-4856-b381-44ab5771b0e3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1318 microversion: 2.1 time: 0.220720 May 25 16:11:26.293373 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 221/447] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:26 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:27.304743 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f3eb61ca-3916-464b-9e94-3d327a999f8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:27.305721 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f3eb61ca-3916-464b-9e94-3d327a999f8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:27.317105 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f3eb61ca-3916-464b-9e94-3d327a999f8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:27.317916 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f3eb61ca-3916-464b-9e94-3d327a999f8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:27.319184 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f3eb61ca-3916-464b-9e94-3d327a999f8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:27.320031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f3eb61ca-3916-464b-9e94-3d327a999f8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:27.454491 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f3eb61ca-3916-464b-9e94-3d327a999f8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:27.462606 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f3eb61ca-3916-464b-9e94-3d327a999f8c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1318 microversion: 2.1 time: 0.164381 May 25 16:11:27.463171 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 227/448] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:27 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:27.822644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:11:27.823191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Wed May 25 16:11:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:11:28.483056 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-98f0cacc-171a-42cd-9907-9ff3ec1b34c9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:28.484045 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-98f0cacc-171a-42cd-9907-9ff3ec1b34c9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:28.504669 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-98f0cacc-171a-42cd-9907-9ff3ec1b34c9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:28.508668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-98f0cacc-171a-42cd-9907-9ff3ec1b34c9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:28.511834 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-98f0cacc-171a-42cd-9907-9ff3ec1b34c9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:28.512388 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-98f0cacc-171a-42cd-9907-9ff3ec1b34c9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:28.694088 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-98f0cacc-171a-42cd-9907-9ff3ec1b34c9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:28.702453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-98f0cacc-171a-42cd-9907-9ff3ec1b34c9 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1318 microversion: 2.1 time: 0.226240 May 25 16:11:28.703082 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 222/449] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:28 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:29.685497 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2eda424a-1f0a-4e9b-a4c3-062e63835948 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:29.686442 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2eda424a-1f0a-4e9b-a4c3-062e63835948 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:29.688935 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:29.689589 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=6 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:29.695408 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2eda424a-1f0a-4e9b-a4c3-062e63835948 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:29.695853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2eda424a-1f0a-4e9b-a4c3-062e63835948 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:29.696634 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2eda424a-1f0a-4e9b-a4c3-062e63835948 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:29.697067 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2eda424a-1f0a-4e9b-a4c3-062e63835948 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:29.719040 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-870f6b30-31ea-4944-85fd-e84ac10ca010 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:29.719647 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-870f6b30-31ea-4944-85fd-e84ac10ca010 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:29.720582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-2eda424a-1f0a-4e9b-a4c3-062e63835948 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lazy-loading 'flavor' on Instance uuid a3950b05-a514-47cb-8eee-c63d90575a10 {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:11:29.721551 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:29.727537 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-870f6b30-31ea-4944-85fd-e84ac10ca010 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:29.728015 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-870f6b30-31ea-4944-85fd-e84ac10ca010 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:29.728795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-870f6b30-31ea-4944-85fd-e84ac10ca010 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:29.729220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-870f6b30-31ea-4944-85fd-e84ac10ca010 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:29.852672 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2eda424a-1f0a-4e9b-a4c3-062e63835948 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/action" status: 200 len: 32 microversion: 2.1 time: 0.171213 May 25 16:11:29.857637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 228/450] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:11:29 2022] POST /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:11:29.863219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e8bb142d-3dcc-4628-a45d-142c65e3056e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:29.863945 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e8bb142d-3dcc-4628-a45d-142c65e3056e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:29.864312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-870f6b30-31ea-4944-85fd-e84ac10ca010 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:29.871182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e8bb142d-3dcc-4628-a45d-142c65e3056e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:29.871608 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e8bb142d-3dcc-4628-a45d-142c65e3056e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:29.871936 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-870f6b30-31ea-4944-85fd-e84ac10ca010 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1318 microversion: 2.1 time: 0.156687 May 25 16:11:29.872397 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e8bb142d-3dcc-4628-a45d-142c65e3056e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:29.872565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 223/451] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:29 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:29.872883 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e8bb142d-3dcc-4628-a45d-142c65e3056e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:30.009838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e8bb142d-3dcc-4628-a45d-142c65e3056e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:30.019538 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e8bb142d-3dcc-4628-a45d-142c65e3056e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.160422 May 25 16:11:30.020218 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 229/452] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:29 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:30.660087 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-e7464d8d-3446-4f00-bf6d-d247ae7f6f0b req-f9d19324-c2b8-4c7d-973d-86115ba0982e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b6bf66-982e-4358-adf4-d5ad0c0cd061", "name": "network-vif-plugged", "status": "completed", "tag": "aae7561e-069c-49cd-b130-6900676f3d8c"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:30.668722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-e7464d8d-3446-4f00-bf6d-d247ae7f6f0b req-f9d19324-c2b8-4c7d-973d-86115ba0982e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:30.669208 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-e7464d8d-3446-4f00-bf6d-d247ae7f6f0b req-f9d19324-c2b8-4c7d-973d-86115ba0982e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:30.681725 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-e7464d8d-3446-4f00-bf6d-d247ae7f6f0b req-f9d19324-c2b8-4c7d-973d-86115ba0982e service nova] Creating event network-vif-plugged:aae7561e-069c-49cd-b130-6900676f3d8c for instance 46b6bf66-982e-4358-adf4-d5ad0c0cd061 on hv-cinder-84327 May 25 16:11:30.686668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-e7464d8d-3446-4f00-bf6d-d247ae7f6f0b req-f9d19324-c2b8-4c7d-973d-86115ba0982e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030545 May 25 16:11:30.687268 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 224/453] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:30.889220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d006c843-623f-4b20-aa90-347fa7d87ab3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:30.889824 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d006c843-623f-4b20-aa90-347fa7d87ab3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:30.897117 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d006c843-623f-4b20-aa90-347fa7d87ab3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:30.897593 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d006c843-623f-4b20-aa90-347fa7d87ab3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:30.898396 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d006c843-623f-4b20-aa90-347fa7d87ab3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:30.898831 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d006c843-623f-4b20-aa90-347fa7d87ab3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:30.914337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:31.030142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d006c843-623f-4b20-aa90-347fa7d87ab3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:31.038000 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d006c843-623f-4b20-aa90-347fa7d87ab3 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1318 microversion: 2.1 time: 0.152753 May 25 16:11:31.038602 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 230/454] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:30 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:31.038741 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7daec3fc-74ae-4cf2-b664-71f8a678351f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:31.039433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7daec3fc-74ae-4cf2-b664-71f8a678351f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:31.046682 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7daec3fc-74ae-4cf2-b664-71f8a678351f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.047123 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7daec3fc-74ae-4cf2-b664-71f8a678351f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.047909 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7daec3fc-74ae-4cf2-b664-71f8a678351f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.048342 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7daec3fc-74ae-4cf2-b664-71f8a678351f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.189854 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7daec3fc-74ae-4cf2-b664-71f8a678351f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:31.198168 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7daec3fc-74ae-4cf2-b664-71f8a678351f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.163788 May 25 16:11:31.198704 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 225/455] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:31 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:11:31.541418 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-34352a17-262e-4ee8-a6c0-f128f99ebb8a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:31.542162 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-34352a17-262e-4ee8-a6c0-f128f99ebb8a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:31.552574 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-34352a17-262e-4ee8-a6c0-f128f99ebb8a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.553339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-34352a17-262e-4ee8-a6c0-f128f99ebb8a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.554601 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-34352a17-262e-4ee8-a6c0-f128f99ebb8a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.555328 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-34352a17-262e-4ee8-a6c0-f128f99ebb8a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.580779 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-34352a17-262e-4ee8-a6c0-f128f99ebb8a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb/ips" status: 200 len: 150 microversion: 2.1 time: 0.046077 May 25 16:11:31.581349 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 231/456] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:11:31 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:31.592197 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99441362-29b3-4cbd-8eb5-24eb3d16cbda"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:31.593270 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:31.599467 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.599947 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.600718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.601153 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.683611 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Invalid volume: volume 99441362-29b3-4cbd-8eb5-24eb3d16cbda is already attached to instances: fb52261b-f0d9-4cfc-a5df-dc306324060a May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: POST /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb/os-volume_attachments HTTP/1.1 May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 74 May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:11:31.685564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {"volumeAttachment": {"volumeId": "99441362-29b3-4cbd-8eb5-24eb3d16cbda"}} May 25 16:11:31.687156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Invalid volume: volume 99441362-29b3-4cbd-8eb5-24eb3d16cbda is already attached to instances: fb52261b-f0d9-4cfc-a5df-dc306324060a May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'server_id': '53b50f41-74ab-479c-898d-14e7396de0bb', 'body': {'volumeAttachment': {'volumeId': '99441362-29b3-4cbd-8eb5-24eb3d16cbda'}}} May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 99441362-29b3-4cbd-8eb5-24eb3d16cbda is already attached to instances: fb52261b-f0d9-4cfc-a5df-dc306324060a May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:31.688036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 99441362-29b3-4cbd-8eb5-24eb3d16cbda is already attached to instances: fb52261b-f0d9-4cfc-a5df-dc306324060a May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:31.689414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:31.690818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:31.690818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:11:31.690818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:11:31.690818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 99441362-29b3-4cbd-8eb5-24eb3d16cbda is already attached to instances: fb52261b-f0d9-4cfc-a5df-dc306324060a May 25 16:11:31.690818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:11:31.690818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 400 to user: Invalid volume: volume 99441362-29b3-4cbd-8eb5-24eb3d16cbda is already attached to instances: fb52261b-f0d9-4cfc-a5df-dc306324060a {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:11:31.690818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a49e81f7-1800-4999-84b8-18f6909fcaf9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099016 May 25 16:11:31.690818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 226/457] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:11:31 2022] POST /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 16:11:31.696225 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5fc59a74-abcd-4235-9da7-3dd7b1327fce tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:31.696743 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5fc59a74-abcd-4235-9da7-3dd7b1327fce tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:31.702982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5fc59a74-abcd-4235-9da7-3dd7b1327fce tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.703427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5fc59a74-abcd-4235-9da7-3dd7b1327fce tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.704217 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5fc59a74-abcd-4235-9da7-3dd7b1327fce tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.704655 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5fc59a74-abcd-4235-9da7-3dd7b1327fce tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.728861 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5fc59a74-abcd-4235-9da7-3dd7b1327fce tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:11:31.810837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5fc59a74-abcd-4235-9da7-3dd7b1327fce tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 204 len: 0 microversion: 2.1 time: 0.118111 May 25 16:11:31.811361 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 232/458] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:11:31 2022] DELETE /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 16:11:31.819905 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-34379e0e-87c9-43eb-a952-2304503cdac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:31.820508 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-34379e0e-87c9-43eb-a952-2304503cdac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:31.827522 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-34379e0e-87c9-43eb-a952-2304503cdac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.827990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-34379e0e-87c9-43eb-a952-2304503cdac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.828743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-34379e0e-87c9-43eb-a952-2304503cdac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:31.829173 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-34379e0e-87c9-43eb-a952-2304503cdac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:31.965253 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-34379e0e-87c9-43eb-a952-2304503cdac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:31.973378 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-34379e0e-87c9-43eb-a952-2304503cdac2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1682 microversion: 2.1 time: 0.157534 May 25 16:11:31.973956 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 227/459] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:31 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:32.057363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-644cab26-3151-4d46-a71b-970da198f6d4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:32.058055 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-644cab26-3151-4d46-a71b-970da198f6d4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:32.067051 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-644cab26-3151-4d46-a71b-970da198f6d4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:32.067671 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-644cab26-3151-4d46-a71b-970da198f6d4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:32.068484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-644cab26-3151-4d46-a71b-970da198f6d4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:32.068922 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-644cab26-3151-4d46-a71b-970da198f6d4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:32.211031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-644cab26-3151-4d46-a71b-970da198f6d4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:32.214930 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4124512c-ba74-4129-b410-8e9f78ca4416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:32.215521 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4124512c-ba74-4129-b410-8e9f78ca4416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:32.219070 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-644cab26-3151-4d46-a71b-970da198f6d4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1318 microversion: 2.1 time: 0.166973 May 25 16:11:32.219614 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 233/460] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:32 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:32.222048 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4124512c-ba74-4129-b410-8e9f78ca4416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:32.222489 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4124512c-ba74-4129-b410-8e9f78ca4416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:32.223248 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4124512c-ba74-4129-b410-8e9f78ca4416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:32.223680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4124512c-ba74-4129-b410-8e9f78ca4416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:32.350067 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4124512c-ba74-4129-b410-8e9f78ca4416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:32.358229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4124512c-ba74-4129-b410-8e9f78ca4416 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.147136 May 25 16:11:32.358794 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 228/461] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:32 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:11:32.995594 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-765ade2b-fcf2-4328-be5f-2cd42dbfe029 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:32.996641 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-765ade2b-fcf2-4328-be5f-2cd42dbfe029 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:33.003487 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-765ade2b-fcf2-4328-be5f-2cd42dbfe029 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:33.003972 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-765ade2b-fcf2-4328-be5f-2cd42dbfe029 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:33.004740 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-765ade2b-fcf2-4328-be5f-2cd42dbfe029 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:33.005177 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-765ade2b-fcf2-4328-be5f-2cd42dbfe029 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:33.133929 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-765ade2b-fcf2-4328-be5f-2cd42dbfe029 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:33.141582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-765ade2b-fcf2-4328-be5f-2cd42dbfe029 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1682 microversion: 2.1 time: 0.152583 May 25 16:11:33.142147 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 234/462] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:32 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:33.240151 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e859ae44-b00e-4b81-adbe-6e7cadd01767 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:33.241163 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e859ae44-b00e-4b81-adbe-6e7cadd01767 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:33.252487 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e859ae44-b00e-4b81-adbe-6e7cadd01767 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:33.253137 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e859ae44-b00e-4b81-adbe-6e7cadd01767 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:33.254397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e859ae44-b00e-4b81-adbe-6e7cadd01767 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:33.255130 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e859ae44-b00e-4b81-adbe-6e7cadd01767 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:33.377262 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f2fc19c8-efb7-414c-8b8b-0503aa0993dc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:33.378009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f2fc19c8-efb7-414c-8b8b-0503aa0993dc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:33.384543 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f2fc19c8-efb7-414c-8b8b-0503aa0993dc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:33.385018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f2fc19c8-efb7-414c-8b8b-0503aa0993dc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:33.385870 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f2fc19c8-efb7-414c-8b8b-0503aa0993dc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:33.386305 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f2fc19c8-efb7-414c-8b8b-0503aa0993dc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:33.391668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e859ae44-b00e-4b81-adbe-6e7cadd01767 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:33.400082 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e859ae44-b00e-4b81-adbe-6e7cadd01767 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1318 microversion: 2.1 time: 0.166657 May 25 16:11:33.400773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 229/463] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:33 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:33.514146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f2fc19c8-efb7-414c-8b8b-0503aa0993dc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:33.523031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f2fc19c8-efb7-414c-8b8b-0503aa0993dc tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.149997 May 25 16:11:33.523663 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 235/464] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:33 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:34.167751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-29e8e5bb-1cfa-462a-8a6c-dab6aa780a34 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:34.168862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-29e8e5bb-1cfa-462a-8a6c-dab6aa780a34 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:34.176338 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29e8e5bb-1cfa-462a-8a6c-dab6aa780a34 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:34.176768 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29e8e5bb-1cfa-462a-8a6c-dab6aa780a34 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:34.177519 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29e8e5bb-1cfa-462a-8a6c-dab6aa780a34 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:34.177944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29e8e5bb-1cfa-462a-8a6c-dab6aa780a34 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:34.310967 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-29e8e5bb-1cfa-462a-8a6c-dab6aa780a34 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:34.318627 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-29e8e5bb-1cfa-462a-8a6c-dab6aa780a34 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1682 microversion: 2.1 time: 0.157408 May 25 16:11:34.319229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 230/465] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:34 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:34.417422 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3e5b5b61-e3c2-4929-b926-40300c17f960 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:34.417993 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3e5b5b61-e3c2-4929-b926-40300c17f960 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:34.424826 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e5b5b61-e3c2-4929-b926-40300c17f960 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:34.425274 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e5b5b61-e3c2-4929-b926-40300c17f960 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:34.426103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e5b5b61-e3c2-4929-b926-40300c17f960 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:34.426524 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e5b5b61-e3c2-4929-b926-40300c17f960 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:34.540863 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e40ec30a-9582-4fb1-8b2b-d83df8407eff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:34.541482 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e40ec30a-9582-4fb1-8b2b-d83df8407eff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:34.547627 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e40ec30a-9582-4fb1-8b2b-d83df8407eff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:34.548140 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e40ec30a-9582-4fb1-8b2b-d83df8407eff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:34.548905 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e40ec30a-9582-4fb1-8b2b-d83df8407eff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:34.549487 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e40ec30a-9582-4fb1-8b2b-d83df8407eff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:34.561003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3e5b5b61-e3c2-4929-b926-40300c17f960 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:34.568831 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3e5b5b61-e3c2-4929-b926-40300c17f960 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1508 microversion: 2.1 time: 0.155416 May 25 16:11:34.569545 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 236/466] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:34 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:34.585748 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-75e662ac-f977-40af-a23b-ea013b1e785f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a0860de-735a-44d7-b4bd-80776eb2f5b6", "device": "/dev/sdb"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:34.587386 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-75e662ac-f977-40af-a23b-ea013b1e785f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:34.593496 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-75e662ac-f977-40af-a23b-ea013b1e785f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:34.593942 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-75e662ac-f977-40af-a23b-ea013b1e785f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:34.594695 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-75e662ac-f977-40af-a23b-ea013b1e785f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:34.595120 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-75e662ac-f977-40af-a23b-ea013b1e785f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:34.775107 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e40ec30a-9582-4fb1-8b2b-d83df8407eff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:34.777470 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:34.785033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e40ec30a-9582-4fb1-8b2b-d83df8407eff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.248473 May 25 16:11:34.785866 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 231/467] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:34 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:34.859724 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-75e662ac-f977-40af-a23b-ea013b1e785f tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "POST /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277652 May 25 16:11:34.865093 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 237/468] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:11:34 2022] POST /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:35.337247 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7204dc5e-4082-4f5a-8b00-0f3765da2997 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:35.337940 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7204dc5e-4082-4f5a-8b00-0f3765da2997 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:35.346633 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7204dc5e-4082-4f5a-8b00-0f3765da2997 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:35.347127 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7204dc5e-4082-4f5a-8b00-0f3765da2997 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:35.347976 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7204dc5e-4082-4f5a-8b00-0f3765da2997 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:35.348444 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7204dc5e-4082-4f5a-8b00-0f3765da2997 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:35.439305 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7204dc5e-4082-4f5a-8b00-0f3765da2997 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:35.449717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7204dc5e-4082-4f5a-8b00-0f3765da2997 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 200 len: 1614 microversion: 2.1 time: 0.116869 May 25 16:11:35.450310 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 232/469] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:35 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:35.710687 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-8df16c4f-44aa-4b78-b30e-6a9c7bb27462 req-645ad2c1-cbd5-49f0-8f5e-febda0ada980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b50f41-74ab-479c-898d-14e7396de0bb", "name": "network-vif-deleted", "tag": "ac4617cf-b210-4ee5-8011-34c4c46ae91a"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:35.720289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-8df16c4f-44aa-4b78-b30e-6a9c7bb27462 req-645ad2c1-cbd5-49f0-8f5e-febda0ada980 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:35.720761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-8df16c4f-44aa-4b78-b30e-6a9c7bb27462 req-645ad2c1-cbd5-49f0-8f5e-febda0ada980 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:35.733450 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-8df16c4f-44aa-4b78-b30e-6a9c7bb27462 req-645ad2c1-cbd5-49f0-8f5e-febda0ada980 service nova] Creating event network-vif-deleted:ac4617cf-b210-4ee5-8011-34c4c46ae91a for instance 53b50f41-74ab-479c-898d-14e7396de0bb on hv-cinder-84327 May 25 16:11:35.739420 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-8df16c4f-44aa-4b78-b30e-6a9c7bb27462 req-645ad2c1-cbd5-49f0-8f5e-febda0ada980 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033089 May 25 16:11:35.740659 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 238/470] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:35.803490 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-80305269-5ef6-4c26-86ba-6b3d91544134 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:35.804187 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-80305269-5ef6-4c26-86ba-6b3d91544134 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:35.811654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-80305269-5ef6-4c26-86ba-6b3d91544134 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:35.812580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-80305269-5ef6-4c26-86ba-6b3d91544134 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:35.813661 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-80305269-5ef6-4c26-86ba-6b3d91544134 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:35.814200 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-80305269-5ef6-4c26-86ba-6b3d91544134 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:35.965460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-80305269-5ef6-4c26-86ba-6b3d91544134 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:35.975752 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-80305269-5ef6-4c26-86ba-6b3d91544134 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.176893 May 25 16:11:35.976360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 233/471] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:35 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:36.468237 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:36.468932 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:36.475360 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:36.475794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:36.476604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:36.477042 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:36.490745 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb HTTP/1.1 May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:11:36.496991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:11:36.498605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '53b50f41-74ab-479c-898d-14e7396de0bb'} May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:11:36.499448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:11:36.500825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:36.502091 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:11:36.502091 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ddd36844-737a-4122-b32f-fea95044b202 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 404 len: 111 microversion: 2.1 time: 0.035241 May 25 16:11:36.507542 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-64dc4ada-872f-4715-bc27-91f71b1bcfb1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '.version_select at 0x7fbaf142d160>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:36.512030 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 239/472] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:36 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:11:36.532652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-64dc4ada-872f-4715-bc27-91f71b1bcfb1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742066034" status: 202 len: 0 microversion: 2.1 time: 0.028814 May 25 16:11:36.533918 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 234/473] 10.222.0.85 () {58 vars in 1220 bytes} [Wed May 25 16:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742066034 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:11:37.008989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6119717c-598b-4231-a5b4-42f348ee2924 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:37.009599 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6119717c-598b-4231-a5b4-42f348ee2924 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:37.017280 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6119717c-598b-4231-a5b4-42f348ee2924 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:37.017731 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6119717c-598b-4231-a5b4-42f348ee2924 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:37.018737 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6119717c-598b-4231-a5b4-42f348ee2924 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:37.019328 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6119717c-598b-4231-a5b4-42f348ee2924 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:37.167428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6119717c-598b-4231-a5b4-42f348ee2924 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:37.176239 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6119717c-598b-4231-a5b4-42f348ee2924 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.171036 May 25 16:11:37.177067 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 240/474] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:37 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:37.250233 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-53c0004c-c0e8-483e-8f67-dee764bed61b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:37.250816 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-53c0004c-c0e8-483e-8f67-dee764bed61b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:37.257603 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-53c0004c-c0e8-483e-8f67-dee764bed61b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:37.257982 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-53c0004c-c0e8-483e-8f67-dee764bed61b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:37.258750 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-53c0004c-c0e8-483e-8f67-dee764bed61b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:37.259189 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-53c0004c-c0e8-483e-8f67-dee764bed61b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:37.383945 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-53c0004c-c0e8-483e-8f67-dee764bed61b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lazy-loading 'services' on Instance uuid fb52261b-f0d9-4cfc-a5df-dc306324060a {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:11:37.495552 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-53c0004c-c0e8-483e-8f67-dee764bed61b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments/99441362-29b3-4cbd-8eb5-24eb3d16cbda" status: 202 len: 0 microversion: 2.1 time: 0.249416 May 25 16:11:37.496192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 235/475] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:11:37 2022] DELETE /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments/99441362-29b3-4cbd-8eb5-24eb3d16cbda => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:11:37.505087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c909978c-0c28-4a82-9343-c051f1611fe3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:37.506095 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c909978c-0c28-4a82-9343-c051f1611fe3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:37.512845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c909978c-0c28-4a82-9343-c051f1611fe3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:37.513689 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c909978c-0c28-4a82-9343-c051f1611fe3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:37.515122 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c909978c-0c28-4a82-9343-c051f1611fe3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:37.515814 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c909978c-0c28-4a82-9343-c051f1611fe3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:37.548752 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c909978c-0c28-4a82-9343-c051f1611fe3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047626 May 25 16:11:37.549499 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 241/476] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:11:37 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:38.194431 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b406fa0d-c65a-46b4-91e6-7045acb6a46a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:38.195114 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b406fa0d-c65a-46b4-91e6-7045acb6a46a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:38.202761 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b406fa0d-c65a-46b4-91e6-7045acb6a46a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:38.203206 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b406fa0d-c65a-46b4-91e6-7045acb6a46a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:38.203997 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b406fa0d-c65a-46b4-91e6-7045acb6a46a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:38.204424 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b406fa0d-c65a-46b4-91e6-7045acb6a46a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:38.342370 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b406fa0d-c65a-46b4-91e6-7045acb6a46a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:38.350721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b406fa0d-c65a-46b4-91e6-7045acb6a46a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.160519 May 25 16:11:38.351331 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 236/477] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:38 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:38.561732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f214b30e-0f49-4bde-bfc2-b3ba1098fb85 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:38.562855 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f214b30e-0f49-4bde-bfc2-b3ba1098fb85 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:38.569935 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f214b30e-0f49-4bde-bfc2-b3ba1098fb85 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:38.570378 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f214b30e-0f49-4bde-bfc2-b3ba1098fb85 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:38.571146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f214b30e-0f49-4bde-bfc2-b3ba1098fb85 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:38.571580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f214b30e-0f49-4bde-bfc2-b3ba1098fb85 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:38.602439 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f214b30e-0f49-4bde-bfc2-b3ba1098fb85 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 May 25 16:11:38.603162 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 242/478] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:11:38 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:39.372135 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2e780b3d-28c6-4841-9d5c-9b543f7da646 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:39.373145 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2e780b3d-28c6-4841-9d5c-9b543f7da646 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:39.384173 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2e780b3d-28c6-4841-9d5c-9b543f7da646 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:39.384918 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2e780b3d-28c6-4841-9d5c-9b543f7da646 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:39.386170 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2e780b3d-28c6-4841-9d5c-9b543f7da646 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:39.386897 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2e780b3d-28c6-4841-9d5c-9b543f7da646 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:39.524028 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2e780b3d-28c6-4841-9d5c-9b543f7da646 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:39.533836 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2e780b3d-28c6-4841-9d5c-9b543f7da646 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.168198 May 25 16:11:39.534405 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 237/479] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:39 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:39.618854 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-03aca945-db01-466e-a214-a6b560a0f5cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:39.620368 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-03aca945-db01-466e-a214-a6b560a0f5cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:39.628455 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-03aca945-db01-466e-a214-a6b560a0f5cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:39.628905 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-03aca945-db01-466e-a214-a6b560a0f5cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:39.629665 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-03aca945-db01-466e-a214-a6b560a0f5cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:39.630095 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-03aca945-db01-466e-a214-a6b560a0f5cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:39.659989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-03aca945-db01-466e-a214-a6b560a0f5cf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047769 May 25 16:11:39.660549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 243/480] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:11:39 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:39.746678 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b94ebccf-e1c9-44c0-a1fe-3a78d8dd8111 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:39.747418 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b94ebccf-e1c9-44c0-a1fe-3a78d8dd8111 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:39.754358 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b94ebccf-e1c9-44c0-a1fe-3a78d8dd8111 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:39.754826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b94ebccf-e1c9-44c0-a1fe-3a78d8dd8111 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:39.755570 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b94ebccf-e1c9-44c0-a1fe-3a78d8dd8111 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:39.756046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b94ebccf-e1c9-44c0-a1fe-3a78d8dd8111 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:39.839086 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-b94ebccf-e1c9-44c0-a1fe-3a78d8dd8111 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lazy-loading 'services' on Instance uuid 6c5f2914-854d-4d77-82e5-680200d4d6c8 {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:11:39.915077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b94ebccf-e1c9-44c0-a1fe-3a78d8dd8111 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/os-volume_attachments/177e2d77-58e3-4a1d-be11-02f454f8616b" status: 202 len: 0 microversion: 2.1 time: 0.175241 May 25 16:11:39.915671 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 238/481] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:11:39 2022] DELETE /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/os-volume_attachments/177e2d77-58e3-4a1d-be11-02f454f8616b => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:11:40.555177 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1f7637ca-cc02-4186-8b40-107c209ebe09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:40.556595 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1f7637ca-cc02-4186-8b40-107c209ebe09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:40.564849 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f7637ca-cc02-4186-8b40-107c209ebe09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:40.565302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f7637ca-cc02-4186-8b40-107c209ebe09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:40.566073 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f7637ca-cc02-4186-8b40-107c209ebe09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:40.566511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1f7637ca-cc02-4186-8b40-107c209ebe09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:40.671897 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4ab8ca9e-792c-4839-8b83-15b89e826b6d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:40.673674 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4ab8ca9e-792c-4839-8b83-15b89e826b6d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:40.680255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4ab8ca9e-792c-4839-8b83-15b89e826b6d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:40.680698 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4ab8ca9e-792c-4839-8b83-15b89e826b6d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:40.681459 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4ab8ca9e-792c-4839-8b83-15b89e826b6d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:40.681891 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4ab8ca9e-792c-4839-8b83-15b89e826b6d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:40.694975 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1f7637ca-cc02-4186-8b40-107c209ebe09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:40.703364 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1f7637ca-cc02-4186-8b40-107c209ebe09 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.154592 May 25 16:11:40.703966 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 244/482] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:40 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:40.711333 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4ab8ca9e-792c-4839-8b83-15b89e826b6d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 May 25 16:11:40.711941 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 239/483] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:11:40 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:41.721273 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cbd42083-fef7-4ab1-af60-1ae8f14592ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:41.721883 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cbd42083-fef7-4ab1-af60-1ae8f14592ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:41.722583 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-cc66d27e-d2d5-46e4-a7f4-80d45c45d23e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:41.723516 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-cc66d27e-d2d5-46e4-a7f4-80d45c45d23e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:41.728796 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cbd42083-fef7-4ab1-af60-1ae8f14592ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:41.729257 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cbd42083-fef7-4ab1-af60-1ae8f14592ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:41.730053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cbd42083-fef7-4ab1-af60-1ae8f14592ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:41.730275 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cc66d27e-d2d5-46e4-a7f4-80d45c45d23e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:41.730581 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cbd42083-fef7-4ab1-af60-1ae8f14592ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:41.730715 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cc66d27e-d2d5-46e4-a7f4-80d45c45d23e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:41.731452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cc66d27e-d2d5-46e4-a7f4-80d45c45d23e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:41.731907 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cc66d27e-d2d5-46e4-a7f4-80d45c45d23e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:41.762233 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-cc66d27e-d2d5-46e4-a7f4-80d45c45d23e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 May 25 16:11:41.762782 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 240/484] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:11:41 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:41.863110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cbd42083-fef7-4ab1-af60-1ae8f14592ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:41.865552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:41.872776 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cbd42083-fef7-4ab1-af60-1ae8f14592ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.155509 May 25 16:11:41.873548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 245/485] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:41 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:42.774302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4ffda965-5b8b-48ee-bee0-6fcce951fd27 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:42.775220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4ffda965-5b8b-48ee-bee0-6fcce951fd27 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:42.779379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:42.785267 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4ffda965-5b8b-48ee-bee0-6fcce951fd27 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:42.785733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4ffda965-5b8b-48ee-bee0-6fcce951fd27 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:42.786489 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4ffda965-5b8b-48ee-bee0-6fcce951fd27 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:42.786925 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4ffda965-5b8b-48ee-bee0-6fcce951fd27 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:42.816662 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4ffda965-5b8b-48ee-bee0-6fcce951fd27 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046448 May 25 16:11:42.817213 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 241/486] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:11:42 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:42.890364 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9abc89f3-5691-47bb-93d4-cb24cda339ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:42.890972 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9abc89f3-5691-47bb-93d4-cb24cda339ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:42.894118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:42.900305 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9abc89f3-5691-47bb-93d4-cb24cda339ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:42.900760 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9abc89f3-5691-47bb-93d4-cb24cda339ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:42.901541 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9abc89f3-5691-47bb-93d4-cb24cda339ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:42.901979 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9abc89f3-5691-47bb-93d4-cb24cda339ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:43.042607 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9abc89f3-5691-47bb-93d4-cb24cda339ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:43.051257 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9abc89f3-5691-47bb-93d4-cb24cda339ec tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.164915 May 25 16:11:43.051857 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 246/487] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:42 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:43.833101 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6f94d509-962d-4f7d-86e0-eec9a0beee17 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:43.834665 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-6f94d509-962d-4f7d-86e0-eec9a0beee17 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:43.845576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6f94d509-962d-4f7d-86e0-eec9a0beee17 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:43.846350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6f94d509-962d-4f7d-86e0-eec9a0beee17 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:43.847606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6f94d509-962d-4f7d-86e0-eec9a0beee17 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:43.848384 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6f94d509-962d-4f7d-86e0-eec9a0beee17 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:43.880984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6f94d509-962d-4f7d-86e0-eec9a0beee17 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054920 May 25 16:11:43.881533 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 242/488] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:11:43 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:44.072480 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-34216759-ffb1-4a4e-a82c-a8d7cb761edd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:44.073680 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-34216759-ffb1-4a4e-a82c-a8d7cb761edd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:44.084972 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-34216759-ffb1-4a4e-a82c-a8d7cb761edd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:44.085619 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-34216759-ffb1-4a4e-a82c-a8d7cb761edd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:44.086887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-34216759-ffb1-4a4e-a82c-a8d7cb761edd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:44.087613 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-34216759-ffb1-4a4e-a82c-a8d7cb761edd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:44.222734 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-34216759-ffb1-4a4e-a82c-a8d7cb761edd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:44.234764 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-34216759-ffb1-4a4e-a82c-a8d7cb761edd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.168518 May 25 16:11:44.235579 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 247/489] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:44 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:44.897292 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e858308d-9724-4b6e-9dfd-e3e35ba62617 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:44.898822 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e858308d-9724-4b6e-9dfd-e3e35ba62617 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:44.907847 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e858308d-9724-4b6e-9dfd-e3e35ba62617 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:44.908309 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e858308d-9724-4b6e-9dfd-e3e35ba62617 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:44.909077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e858308d-9724-4b6e-9dfd-e3e35ba62617 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:44.909512 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e858308d-9724-4b6e-9dfd-e3e35ba62617 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:44.938818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e858308d-9724-4b6e-9dfd-e3e35ba62617 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048575 May 25 16:11:44.939394 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 243/490] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:11:44 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:45.256847 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-16692868-8859-417e-86d2-be58a1b56249 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:45.257474 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-16692868-8859-417e-86d2-be58a1b56249 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:45.264278 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-16692868-8859-417e-86d2-be58a1b56249 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:45.264735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-16692868-8859-417e-86d2-be58a1b56249 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:45.265497 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-16692868-8859-417e-86d2-be58a1b56249 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:45.265933 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-16692868-8859-417e-86d2-be58a1b56249 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:45.398684 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-16692868-8859-417e-86d2-be58a1b56249 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:45.406961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-16692868-8859-417e-86d2-be58a1b56249 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.154011 May 25 16:11:45.407495 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 248/491] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:45 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:45.950342 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-935638a8-5bdd-48e4-bdcb-095bae61c4a8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:45.951290 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-935638a8-5bdd-48e4-bdcb-095bae61c4a8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:45.958005 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-935638a8-5bdd-48e4-bdcb-095bae61c4a8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:45.958456 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-935638a8-5bdd-48e4-bdcb-095bae61c4a8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:45.959240 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-935638a8-5bdd-48e4-bdcb-095bae61c4a8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:45.959672 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-935638a8-5bdd-48e4-bdcb-095bae61c4a8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:45.989137 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-935638a8-5bdd-48e4-bdcb-095bae61c4a8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043035 May 25 16:11:45.989695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 244/492] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:11:45 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:11:46.057418 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-57daa2d9-7eb3-4bb3-a848-09affe18256b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:46.057907 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-57daa2d9-7eb3-4bb3-a848-09affe18256b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:46.064128 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-57daa2d9-7eb3-4bb3-a848-09affe18256b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:46.064598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-57daa2d9-7eb3-4bb3-a848-09affe18256b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:46.065345 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-57daa2d9-7eb3-4bb3-a848-09affe18256b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:46.065774 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-57daa2d9-7eb3-4bb3-a848-09affe18256b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:46.090631 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-57daa2d9-7eb3-4bb3-a848-09affe18256b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:11:46.171463 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-57daa2d9-7eb3-4bb3-a848-09affe18256b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 204 len: 0 microversion: 2.1 time: 0.117487 May 25 16:11:46.172068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 249/493] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:11:46 2022] DELETE /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:11:46.182164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9930bdcc-8e8b-457c-996a-d9f88ea3d276 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:46.182771 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9930bdcc-8e8b-457c-996a-d9f88ea3d276 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:46.189156 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9930bdcc-8e8b-457c-996a-d9f88ea3d276 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:46.189627 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9930bdcc-8e8b-457c-996a-d9f88ea3d276 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:46.190558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9930bdcc-8e8b-457c-996a-d9f88ea3d276 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:46.191014 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9930bdcc-8e8b-457c-996a-d9f88ea3d276 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:46.336366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9930bdcc-8e8b-457c-996a-d9f88ea3d276 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:46.341758 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9930bdcc-8e8b-457c-996a-d9f88ea3d276 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1680 microversion: 2.1 time: 0.163767 May 25 16:11:46.342526 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 245/494] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:46 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:46.429004 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9456c8c0-0044-488a-8cfc-5b11901b9905 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:46.429781 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9456c8c0-0044-488a-8cfc-5b11901b9905 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:46.438974 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9456c8c0-0044-488a-8cfc-5b11901b9905 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:46.439421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9456c8c0-0044-488a-8cfc-5b11901b9905 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:46.440226 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9456c8c0-0044-488a-8cfc-5b11901b9905 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:46.440662 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9456c8c0-0044-488a-8cfc-5b11901b9905 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:46.573374 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9456c8c0-0044-488a-8cfc-5b11901b9905 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:46.581803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9456c8c0-0044-488a-8cfc-5b11901b9905 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.159963 May 25 16:11:46.582374 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 250/495] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:46 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:47.359601 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-67332903-9c78-4299-a6e8-3941ba147c4c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:47.360259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-67332903-9c78-4299-a6e8-3941ba147c4c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:47.367855 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67332903-9c78-4299-a6e8-3941ba147c4c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:47.368380 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67332903-9c78-4299-a6e8-3941ba147c4c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:47.369080 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67332903-9c78-4299-a6e8-3941ba147c4c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:47.369521 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-67332903-9c78-4299-a6e8-3941ba147c4c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:47.410709 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-61ff1d5f-2303-41f0-ad4d-95af89fe243b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:47.417007 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-61ff1d5f-2303-41f0-ad4d-95af89fe243b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:47.417460 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-61ff1d5f-2303-41f0-ad4d-95af89fe243b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:47.485995 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-61ff1d5f-2303-41f0-ad4d-95af89fe243b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Going to try to stop instance {{(pid=117764) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 16:11:47.524118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-67332903-9c78-4299-a6e8-3941ba147c4c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:47.534385 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-67332903-9c78-4299-a6e8-3941ba147c4c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1680 microversion: 2.1 time: 0.179183 May 25 16:11:47.535297 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 246/496] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:47 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:47.544882 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-61ff1d5f-2303-41f0-ad4d-95af89fe243b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/action" status: 202 len: 0 microversion: 2.1 time: 0.138132 May 25 16:11:47.545748 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 251/497] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:11:47 2022] POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:11:47.554819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f359d166-014d-4f7c-b8e1-db6f23ba3cfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:47.555503 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f359d166-014d-4f7c-b8e1-db6f23ba3cfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:47.562564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f359d166-014d-4f7c-b8e1-db6f23ba3cfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:47.563024 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f359d166-014d-4f7c-b8e1-db6f23ba3cfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:47.563795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f359d166-014d-4f7c-b8e1-db6f23ba3cfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:47.564268 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f359d166-014d-4f7c-b8e1-db6f23ba3cfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:47.600115 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-387e680e-1c50-49d4-bdfc-93119b1292eb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:47.600968 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-387e680e-1c50-49d4-bdfc-93119b1292eb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:47.608505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-387e680e-1c50-49d4-bdfc-93119b1292eb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:47.609050 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-387e680e-1c50-49d4-bdfc-93119b1292eb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:47.609862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-387e680e-1c50-49d4-bdfc-93119b1292eb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:47.610308 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-387e680e-1c50-49d4-bdfc-93119b1292eb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:47.707308 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f359d166-014d-4f7c-b8e1-db6f23ba3cfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:47.715511 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f359d166-014d-4f7c-b8e1-db6f23ba3cfd tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.165270 May 25 16:11:47.716367 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 247/498] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:47 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:47.746964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-387e680e-1c50-49d4-bdfc-93119b1292eb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:47.755083 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-387e680e-1c50-49d4-bdfc-93119b1292eb tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.159945 May 25 16:11:47.755685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 252/499] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:47 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:48.556514 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a58ff1f4-223c-4609-87d0-8a3b3c6f1e75 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:48.557482 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a58ff1f4-223c-4609-87d0-8a3b3c6f1e75 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:48.566390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a58ff1f4-223c-4609-87d0-8a3b3c6f1e75 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:48.566768 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a58ff1f4-223c-4609-87d0-8a3b3c6f1e75 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:48.567527 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a58ff1f4-223c-4609-87d0-8a3b3c6f1e75 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:48.567985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a58ff1f4-223c-4609-87d0-8a3b3c6f1e75 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:48.570570 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:48.705184 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a58ff1f4-223c-4609-87d0-8a3b3c6f1e75 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:48.716761 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a58ff1f4-223c-4609-87d0-8a3b3c6f1e75 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1680 microversion: 2.1 time: 0.166530 May 25 16:11:48.717513 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 248/500] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:48 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:48.735882 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9861c6fe-c14d-4d5b-b6b9-97f52a51583e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:48.736532 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9861c6fe-c14d-4d5b-b6b9-97f52a51583e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:48.746049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9861c6fe-c14d-4d5b-b6b9-97f52a51583e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:48.746669 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9861c6fe-c14d-4d5b-b6b9-97f52a51583e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:48.747873 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9861c6fe-c14d-4d5b-b6b9-97f52a51583e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:48.748432 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9861c6fe-c14d-4d5b-b6b9-97f52a51583e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:48.776081 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-04646fda-0592-4334-b87b-daed1804356d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:48.776818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-04646fda-0592-4334-b87b-daed1804356d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:48.784270 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-04646fda-0592-4334-b87b-daed1804356d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:48.784867 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-04646fda-0592-4334-b87b-daed1804356d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:48.786013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-04646fda-0592-4334-b87b-daed1804356d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:48.786540 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-04646fda-0592-4334-b87b-daed1804356d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:48.885743 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9861c6fe-c14d-4d5b-b6b9-97f52a51583e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:48.894103 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9861c6fe-c14d-4d5b-b6b9-97f52a51583e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1724 microversion: 2.1 time: 0.164223 May 25 16:11:48.894665 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 253/501] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:48 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:48.913789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-04646fda-0592-4334-b87b-daed1804356d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:48.921893 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-04646fda-0592-4334-b87b-daed1804356d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.149709 May 25 16:11:48.922460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 249/502] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:48 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:49.734845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-368ed3cf-7474-4183-a533-4f2eab7ed794 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:49.735440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-368ed3cf-7474-4183-a533-4f2eab7ed794 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:49.742339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-368ed3cf-7474-4183-a533-4f2eab7ed794 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:49.742920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-368ed3cf-7474-4183-a533-4f2eab7ed794 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:49.743587 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-368ed3cf-7474-4183-a533-4f2eab7ed794 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:49.744065 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-368ed3cf-7474-4183-a533-4f2eab7ed794 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:49.875875 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-368ed3cf-7474-4183-a533-4f2eab7ed794 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:49.885308 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-368ed3cf-7474-4183-a533-4f2eab7ed794 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1680 microversion: 2.1 time: 0.154342 May 25 16:11:49.886470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 254/503] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:49 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:49.911795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b9379c27-6add-4c52-800d-88656faa6309 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:49.912467 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b9379c27-6add-4c52-800d-88656faa6309 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:49.919164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b9379c27-6add-4c52-800d-88656faa6309 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:49.919614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b9379c27-6add-4c52-800d-88656faa6309 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:49.920407 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b9379c27-6add-4c52-800d-88656faa6309 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:49.920845 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b9379c27-6add-4c52-800d-88656faa6309 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:49.938456 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-82a35978-0f9f-4e4a-b522-63e17cb89cc2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:49.939377 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-82a35978-0f9f-4e4a-b522-63e17cb89cc2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:49.946116 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-82a35978-0f9f-4e4a-b522-63e17cb89cc2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:49.946548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-82a35978-0f9f-4e4a-b522-63e17cb89cc2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:49.947550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-82a35978-0f9f-4e4a-b522-63e17cb89cc2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:49.947745 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-82a35978-0f9f-4e4a-b522-63e17cb89cc2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:50.056619 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b9379c27-6add-4c52-800d-88656faa6309 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:50.064196 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b9379c27-6add-4c52-800d-88656faa6309 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.156384 May 25 16:11:50.065026 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 250/504] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:49 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:50.085866 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-82a35978-0f9f-4e4a-b522-63e17cb89cc2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:50.093960 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-82a35978-0f9f-4e4a-b522-63e17cb89cc2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.159387 May 25 16:11:50.094525 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 255/505] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:49 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:11:50.904415 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4baf90ea-483c-4b02-8081-8df73fa5801a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:50.905013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4baf90ea-483c-4b02-8081-8df73fa5801a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:50.911520 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4baf90ea-483c-4b02-8081-8df73fa5801a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:50.913954 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4baf90ea-483c-4b02-8081-8df73fa5801a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:50.914711 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4baf90ea-483c-4b02-8081-8df73fa5801a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:50.915136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4baf90ea-483c-4b02-8081-8df73fa5801a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:51.081852 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3b6fbeab-45eb-4c99-b280-9faf6436dab7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:51.082564 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3b6fbeab-45eb-4c99-b280-9faf6436dab7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:51.089844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3b6fbeab-45eb-4c99-b280-9faf6436dab7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:51.090331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3b6fbeab-45eb-4c99-b280-9faf6436dab7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:51.091120 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3b6fbeab-45eb-4c99-b280-9faf6436dab7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:51.091719 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3b6fbeab-45eb-4c99-b280-9faf6436dab7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:51.121672 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4baf90ea-483c-4b02-8081-8df73fa5801a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:51.130888 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4baf90ea-483c-4b02-8081-8df73fa5801a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1680 microversion: 2.1 time: 0.230229 May 25 16:11:51.131700 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 251/506] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:50 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:51.138777 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-110f5bef-e117-4ff3-83dd-f04b2d37591a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:51.139433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-110f5bef-e117-4ff3-83dd-f04b2d37591a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:51.153306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-110f5bef-e117-4ff3-83dd-f04b2d37591a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:51.154163 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-110f5bef-e117-4ff3-83dd-f04b2d37591a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:51.155025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-110f5bef-e117-4ff3-83dd-f04b2d37591a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:51.155465 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-110f5bef-e117-4ff3-83dd-f04b2d37591a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:51.248167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3b6fbeab-45eb-4c99-b280-9faf6436dab7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:51.256854 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3b6fbeab-45eb-4c99-b280-9faf6436dab7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.179750 May 25 16:11:51.267106 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 256/507] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:51 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:11:51.347445 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-110f5bef-e117-4ff3-83dd-f04b2d37591a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:51.356164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-110f5bef-e117-4ff3-83dd-f04b2d37591a tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.223227 May 25 16:11:51.356725 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 252/508] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:51 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:51.496625 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-a54e684c-db2d-48e9-aee1-8e6e691caf94 req-54bfe327-7ecc-47fc-8511-51c5595400d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb52261b-f0d9-4cfc-a5df-dc306324060a", "name": "network-vif-deleted", "tag": "149c600b-b80f-41a1-a754-cb48b95c5cb2"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:51.505302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-a54e684c-db2d-48e9-aee1-8e6e691caf94 req-54bfe327-7ecc-47fc-8511-51c5595400d7 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:51.505901 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-a54e684c-db2d-48e9-aee1-8e6e691caf94 req-54bfe327-7ecc-47fc-8511-51c5595400d7 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:51.519193 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-a54e684c-db2d-48e9-aee1-8e6e691caf94 req-54bfe327-7ecc-47fc-8511-51c5595400d7 service nova] Creating event network-vif-deleted:149c600b-b80f-41a1-a754-cb48b95c5cb2 for instance fb52261b-f0d9-4cfc-a5df-dc306324060a on hv-cinder-84327 May 25 16:11:51.525053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-a54e684c-db2d-48e9-aee1-8e6e691caf94 req-54bfe327-7ecc-47fc-8511-51c5595400d7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032218 May 25 16:11:51.525823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 257/509] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:52.151101 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5e866126-2bf1-4c9e-a89e-52f3e66a843a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:52.151900 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5e866126-2bf1-4c9e-a89e-52f3e66a843a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:52.164690 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5e866126-2bf1-4c9e-a89e-52f3e66a843a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:52.170988 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5e866126-2bf1-4c9e-a89e-52f3e66a843a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:52.172292 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5e866126-2bf1-4c9e-a89e-52f3e66a843a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:52.175399 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5e866126-2bf1-4c9e-a89e-52f3e66a843a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:52.270895 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5e866126-2bf1-4c9e-a89e-52f3e66a843a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:52.276550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a827409d-8d11-4352-a113-051108069e82 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:52.277246 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a827409d-8d11-4352-a113-051108069e82 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:52.278856 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5e866126-2bf1-4c9e-a89e-52f3e66a843a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 200 len: 1325 microversion: 2.1 time: 0.133590 May 25 16:11:52.279430 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 253/510] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:52 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 1325 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:52.287771 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a827409d-8d11-4352-a113-051108069e82 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:52.287920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a827409d-8d11-4352-a113-051108069e82 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:52.288692 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a827409d-8d11-4352-a113-051108069e82 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:52.289123 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a827409d-8d11-4352-a113-051108069e82 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:52.374198 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e0457bb7-b9d3-45b0-8df6-4a3b24e21e16 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:52.374758 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e0457bb7-b9d3-45b0-8df6-4a3b24e21e16 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:52.381893 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0457bb7-b9d3-45b0-8df6-4a3b24e21e16 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:52.382525 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0457bb7-b9d3-45b0-8df6-4a3b24e21e16 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:52.383408 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0457bb7-b9d3-45b0-8df6-4a3b24e21e16 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:52.383944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0457bb7-b9d3-45b0-8df6-4a3b24e21e16 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:52.439734 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a827409d-8d11-4352-a113-051108069e82 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:52.449833 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a827409d-8d11-4352-a113-051108069e82 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.177492 May 25 16:11:52.450960 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 258/511] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:52 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:52.522986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e0457bb7-b9d3-45b0-8df6-4a3b24e21e16 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:52.531072 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e0457bb7-b9d3-45b0-8df6-4a3b24e21e16 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.160867 May 25 16:11:52.531629 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 254/512] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:52 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:53.296333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:53.296965 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:53.304097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:53.304546 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:53.305278 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:53.305734 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:53.319249 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a HTTP/1.1 May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:11:53.320927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:11:53.325652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'fb52261b-f0d9-4cfc-a5df-dc306324060a'} May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:11:53.326718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:11:53.328319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:53.330043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:11:53.330043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-7cc1a0f6-ae83-466a-bc5b-c1e09d8ab189 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 404 len: 111 microversion: 2.1 time: 0.029869 May 25 16:11:53.330043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 259/513] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:53 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:11:53.331614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ac4757d8-4a57-42a7-868a-63ab727fd0e9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '.version_select at 0x7fbae3ec01f0>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:53.352577 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ac4757d8-4a57-42a7-868a-63ab727fd0e9 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964042399" status: 202 len: 0 microversion: 2.1 time: 0.022494 May 25 16:11:53.352577 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 255/514] 10.222.0.85 () {58 vars in 1217 bytes} [Wed May 25 16:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964042399 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:11:53.466535 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e86d5bac-63c5-472f-9ea4-5baffaff07f1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:53.467315 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e86d5bac-63c5-472f-9ea4-5baffaff07f1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:53.473841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e86d5bac-63c5-472f-9ea4-5baffaff07f1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:53.474298 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e86d5bac-63c5-472f-9ea4-5baffaff07f1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:53.475173 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e86d5bac-63c5-472f-9ea4-5baffaff07f1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:53.475577 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e86d5bac-63c5-472f-9ea4-5baffaff07f1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:53.549033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9cac463f-ab71-429b-b5b0-a2f8aba83811 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:53.549722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9cac463f-ab71-429b-b5b0-a2f8aba83811 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:53.556098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9cac463f-ab71-429b-b5b0-a2f8aba83811 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:53.556795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9cac463f-ab71-429b-b5b0-a2f8aba83811 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:53.557568 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9cac463f-ab71-429b-b5b0-a2f8aba83811 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:53.558169 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9cac463f-ab71-429b-b5b0-a2f8aba83811 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:53.696860 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9cac463f-ab71-429b-b5b0-a2f8aba83811 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:53.705100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9cac463f-ab71-429b-b5b0-a2f8aba83811 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.160908 May 25 16:11:53.705672 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 256/515] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:53 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:11:53.754435 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e86d5bac-63c5-472f-9ea4-5baffaff07f1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:53.762308 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e86d5bac-63c5-472f-9ea4-5baffaff07f1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.299745 May 25 16:11:53.762871 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 260/516] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:53 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:54.077753 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a9c168c3-4efc-411b-926c-f66cd584c4a7 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: .version_select at 0x7fbae3e8b5e0>, body: {"keypair": {"name": "tempest-keypair-841958060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk00wtIixfvossvAtRjLpTbVCk8IBlyHWk2b5GFyT+Zwb4fFF9B8CAj/f+VYVh4tjIxw1BcjeeIfXZINunYs7vAQXM5vzsFrBw7TH8qGlOBV4VK9CW2rXXiEXVG5XNcrQ=="}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:54.091747 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-a9c168c3-4efc-411b-926c-f66cd584c4a7 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for project 32e48e8e884b4840ba54d546d82d2334. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:11:54.095543 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-a9c168c3-4efc-411b-926c-f66cd584c4a7 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for user 708fdc537e1747d7bd5917ed7af9c368 and project 32e48e8e884b4840ba54d546d82d2334. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:11:54.118710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a9c168c3-4efc-411b-926c-f66cd584c4a7 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044921 May 25 16:11:54.119311 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 257/517] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:11:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:11:54.381663 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c0a9a403-6d11-4948-8f1c-6c6cea5c96b8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:54.382196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c0a9a403-6d11-4948-8f1c-6c6cea5c96b8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:54.389230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c0a9a403-6d11-4948-8f1c-6c6cea5c96b8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:54.389754 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c0a9a403-6d11-4948-8f1c-6c6cea5c96b8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:54.391301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c0a9a403-6d11-4948-8f1c-6c6cea5c96b8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:54.391768 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c0a9a403-6d11-4948-8f1c-6c6cea5c96b8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:54.394607 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:54.481463 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-c0a9a403-6d11-4948-8f1c-6c6cea5c96b8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lazy-loading 'services' on Instance uuid 46b6bf66-982e-4358-adf4-d5ad0c0cd061 {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:11:54.560853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c0a9a403-6d11-4948-8f1c-6c6cea5c96b8 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "DELETE /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061/os-volume_attachments/7a0860de-735a-44d7-b4bd-80776eb2f5b6" status: 202 len: 0 microversion: 2.1 time: 0.183075 May 25 16:11:54.561409 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 261/518] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:11:54 2022] DELETE /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061/os-volume_attachments/7a0860de-735a-44d7-b4bd-80776eb2f5b6 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:11:54.723111 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2dfc8d3c-1bba-4a15-be16-f36e09e3c2ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:54.723731 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2dfc8d3c-1bba-4a15-be16-f36e09e3c2ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:54.731657 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2dfc8d3c-1bba-4a15-be16-f36e09e3c2ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:54.732219 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2dfc8d3c-1bba-4a15-be16-f36e09e3c2ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:54.733040 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2dfc8d3c-1bba-4a15-be16-f36e09e3c2ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:54.733477 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2dfc8d3c-1bba-4a15-be16-f36e09e3c2ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:54.781017 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2b6eef6f-95ca-4e58-b11f-1260810302a5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:54.781721 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2b6eef6f-95ca-4e58-b11f-1260810302a5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:54.788387 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b6eef6f-95ca-4e58-b11f-1260810302a5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:54.788827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b6eef6f-95ca-4e58-b11f-1260810302a5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:54.789591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b6eef6f-95ca-4e58-b11f-1260810302a5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:54.790017 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b6eef6f-95ca-4e58-b11f-1260810302a5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:54.928240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2b6eef6f-95ca-4e58-b11f-1260810302a5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:54.932203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2dfc8d3c-1bba-4a15-be16-f36e09e3c2ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:54.935951 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2b6eef6f-95ca-4e58-b11f-1260810302a5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.159199 May 25 16:11:54.944911 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 262/519] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:54 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:54.945095 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2dfc8d3c-1bba-4a15-be16-f36e09e3c2ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1736 microversion: 2.1 time: 0.221154 May 25 16:11:54.945095 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 258/520] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:54 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:55.531758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1714610011", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2dc3f38-efe8-41d0-ba54-fbd07705ad76"}], "security_groups": [{"name": "tempest-securitygroup--1164758059"}], "key_name": "tempest-keypair-841958060", "user_data": "}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:55.636853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.network.neutron [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] validate_networks() for [('a2dc3f38-efe8-41d0-ba54-fbd07705ad76', None, None, None, None, None)] {{(pid=117764) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:11:55.953265 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3aa7fefa-81cb-478b-8dd9-eec05d012eed tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:55.953840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3aa7fefa-81cb-478b-8dd9-eec05d012eed tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:55.960704 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3aa7fefa-81cb-478b-8dd9-eec05d012eed tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:55.961141 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3aa7fefa-81cb-478b-8dd9-eec05d012eed tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:55.961872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3aa7fefa-81cb-478b-8dd9-eec05d012eed tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:55.962325 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3aa7fefa-81cb-478b-8dd9-eec05d012eed tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.014364 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Flavor limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:11:56.014875 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Image limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:11:56.016501 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Flavor pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:11:56.016996 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Image pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:11:56.017488 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:11:56.027384 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.027970 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.028993 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.029432 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.048229 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for project 32e48e8e884b4840ba54d546d82d2334. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:11:56.053432 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for user 708fdc537e1747d7bd5917ed7af9c368 and project 32e48e8e884b4840ba54d546d82d2334. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:11:56.066514 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Going to run 1 instances... {{(pid=117764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:11:56.069414 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:11:56.118472 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cd7c99f9-17df-4609-afc4-e50cf4528c2c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.593448 May 25 16:11:56.119551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 263/521] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:11:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:11:56.128428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e93a7375-47e2-425a-bf44-55ffa0b10208 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:56.129299 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e93a7375-47e2-425a-bf44-55ffa0b10208 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:56.137082 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e93a7375-47e2-425a-bf44-55ffa0b10208 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.137765 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e93a7375-47e2-425a-bf44-55ffa0b10208 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.138726 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e93a7375-47e2-425a-bf44-55ffa0b10208 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.139321 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e93a7375-47e2-425a-bf44-55ffa0b10208 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.305281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e93a7375-47e2-425a-bf44-55ffa0b10208 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:56.314295 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e93a7375-47e2-425a-bf44-55ffa0b10208 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1716 microversion: 2.1 time: 0.193511 May 25 16:11:56.315170 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 264/522] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:56 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1716 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:56.319837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f6b1bb43-e5cf-42ff-ac51-baf83f06ff30 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:56.320539 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f6b1bb43-e5cf-42ff-ac51-baf83f06ff30 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:56.378423 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3aa7fefa-81cb-478b-8dd9-eec05d012eed tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:56.385894 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f6b1bb43-e5cf-42ff-ac51-baf83f06ff30 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:56.389110 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3aa7fefa-81cb-478b-8dd9-eec05d012eed tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.439902 May 25 16:11:56.391773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 259/523] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:55 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:56.400053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f6b1bb43-e5cf-42ff-ac51-baf83f06ff30 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1241 microversion: 2.1 time: 0.077730 May 25 16:11:56.400053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 265/524] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:56 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:56.467563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:56.468167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:56.477507 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.477959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.479071 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.479202 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.568757 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] HTTP exception thrown: Cannot 'detach_volume' instance a3950b05-a514-47cb-8eee-c63d90575a10 while it is in vm_state rescued May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Request method failure captured: May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: DELETE /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments/5bd8486c-19f1-45ce-a4d3-1dccc8828c60 HTTP/1.1 May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRflM6mHDm1IBYk5QaFi8bNjnvFMogN6K5xhr0eF8qcFq4HnvnAwua1TzxRwkhZrxQgnNUGLSd59qg-4sCGheYS3-r_aF3j2JLouc0h15X9XI1GCCUOHxQjrZ03NCFul-f6dXb6yj03zJ8KDl-0VtoQLd6EKr99XEa8_V75b8Gqj1M May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:11:56.570426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7733d8b5059433eb18dc6b174eb9533", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: d0427d9cce40423185a40df61c3617a6 May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:11:56.572036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Cannot 'detach_volume' instance a3950b05-a514-47cb-8eee-c63d90575a10 while it is in vm_state rescued May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'server_id': 'a3950b05-a514-47cb-8eee-c63d90575a10', 'id': '5bd8486c-19f1-45ce-a4d3-1dccc8828c60'} May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a3950b05-a514-47cb-8eee-c63d90575a10 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:11:56.572982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a3950b05-a514-47cb-8eee-c63d90575a10 while it is in vm_state rescued May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a3950b05-a514-47cb-8eee-c63d90575a10 while it is in vm_state rescued May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:11:56.574425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Returning 409 to user: Cannot 'detach_volume' instance a3950b05-a514-47cb-8eee-c63d90575a10 while it is in vm_state rescued {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:11:56.575591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-04d4415e-3acf-42ef-8d39-7ce1f19e2624 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments/5bd8486c-19f1-45ce-a4d3-1dccc8828c60" status: 409 len: 152 microversion: 2.1 time: 0.109069 May 25 16:11:56.575591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 266/525] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:11:56 2022] DELETE /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments/5bd8486c-19f1-45ce-a4d3-1dccc8828c60 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 16:11:56.583477 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-819399c4-0367-46b4-a6b4-33ad8ea3d8ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:56.584041 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-819399c4-0367-46b4-a6b4-33ad8ea3d8ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:56.592994 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-819399c4-0367-46b4-a6b4-33ad8ea3d8ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.593452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-819399c4-0367-46b4-a6b4-33ad8ea3d8ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.594230 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-819399c4-0367-46b4-a6b4-33ad8ea3d8ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.594677 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-819399c4-0367-46b4-a6b4-33ad8ea3d8ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.669909 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-819399c4-0367-46b4-a6b4-33ad8ea3d8ac tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "POST /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/action" status: 202 len: 0 microversion: 2.1 time: 0.090127 May 25 16:11:56.676013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 260/526] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:11:56 2022] POST /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:11:56.680772 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-53139085-f287-4561-8663-6906a6dc1dff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:56.681477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-53139085-f287-4561-8663-6906a6dc1dff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:56.687965 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-53139085-f287-4561-8663-6906a6dc1dff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.688508 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-53139085-f287-4561-8663-6906a6dc1dff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.689380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-53139085-f287-4561-8663-6906a6dc1dff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.689902 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-53139085-f287-4561-8663-6906a6dc1dff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.744675 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-11985289-8520-414e-a795-28e14a4ec63a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:56.745232 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-11985289-8520-414e-a795-28e14a4ec63a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:56.751803 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-11985289-8520-414e-a795-28e14a4ec63a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.752488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-11985289-8520-414e-a795-28e14a4ec63a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.753424 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-11985289-8520-414e-a795-28e14a4ec63a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.754009 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-11985289-8520-414e-a795-28e14a4ec63a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.787646 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-11985289-8520-414e-a795-28e14a4ec63a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Going to try to terminate instance {{(pid=117763) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:11:56.846088 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-53139085-f287-4561-8663-6906a6dc1dff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:56.860823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-53139085-f287-4561-8663-6906a6dc1dff tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1724 microversion: 2.1 time: 0.184162 May 25 16:11:56.868172 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 267/527] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:56 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:56.883100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-11985289-8520-414e-a795-28e14a4ec63a tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "DELETE /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 204 len: 0 microversion: 2.1 time: 0.142359 May 25 16:11:56.883808 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 261/528] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:11:56 2022] DELETE /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 16:11:56.892911 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ff0028db-aa03-48b5-bd61-0de987e9981c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:56.893520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ff0028db-aa03-48b5-bd61-0de987e9981c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:56.900063 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ff0028db-aa03-48b5-bd61-0de987e9981c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.900735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ff0028db-aa03-48b5-bd61-0de987e9981c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:56.901514 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ff0028db-aa03-48b5-bd61-0de987e9981c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:56.902016 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ff0028db-aa03-48b5-bd61-0de987e9981c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:57.245804 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ff0028db-aa03-48b5-bd61-0de987e9981c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:57.257152 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ff0028db-aa03-48b5-bd61-0de987e9981c tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1514 microversion: 2.1 time: 0.368236 May 25 16:11:57.257928 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 268/529] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:56 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:57.413380 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-606d43a2-5daa-4f60-8e01-1c4109560f21 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:57.414505 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-606d43a2-5daa-4f60-8e01-1c4109560f21 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:57.416461 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-71bafba4-6f47-48b0-9ae5-a442871c6d31 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:57.417921 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-71bafba4-6f47-48b0-9ae5-a442871c6d31 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:57.423985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-606d43a2-5daa-4f60-8e01-1c4109560f21 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:57.424429 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-606d43a2-5daa-4f60-8e01-1c4109560f21 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:57.425186 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-606d43a2-5daa-4f60-8e01-1c4109560f21 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:57.425484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-71bafba4-6f47-48b0-9ae5-a442871c6d31 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:57.425648 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-606d43a2-5daa-4f60-8e01-1c4109560f21 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:57.425921 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-71bafba4-6f47-48b0-9ae5-a442871c6d31 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:57.426681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-71bafba4-6f47-48b0-9ae5-a442871c6d31 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:57.427118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-71bafba4-6f47-48b0-9ae5-a442871c6d31 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:57.488685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-71bafba4-6f47-48b0-9ae5-a442871c6d31 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:57.496397 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-71bafba4-6f47-48b0-9ae5-a442871c6d31 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1293 microversion: 2.1 time: 0.086248 May 25 16:11:57.496890 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 269/530] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:57 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:57.556188 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-606d43a2-5daa-4f60-8e01-1c4109560f21 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:57.564833 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-606d43a2-5daa-4f60-8e01-1c4109560f21 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.158630 May 25 16:11:57.565407 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 262/531] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:57 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:57.883090 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-72c10211-a88a-4b63-aa33-c40a8e34971f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:57.884099 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-72c10211-a88a-4b63-aa33-c40a8e34971f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:57.893590 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72c10211-a88a-4b63-aa33-c40a8e34971f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:57.894044 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72c10211-a88a-4b63-aa33-c40a8e34971f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:57.894807 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72c10211-a88a-4b63-aa33-c40a8e34971f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:57.895243 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72c10211-a88a-4b63-aa33-c40a8e34971f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:58.025405 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-72c10211-a88a-4b63-aa33-c40a8e34971f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:58.037773 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-72c10211-a88a-4b63-aa33-c40a8e34971f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1724 microversion: 2.1 time: 0.160877 May 25 16:11:58.038536 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 270/532] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:57 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:58.279265 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-91d6ac78-594e-4e6f-b4ca-66627ecdf7fd tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:58.280201 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-91d6ac78-594e-4e6f-b4ca-66627ecdf7fd tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:58.287864 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-91d6ac78-594e-4e6f-b4ca-66627ecdf7fd tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:58.288436 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-91d6ac78-594e-4e6f-b4ca-66627ecdf7fd tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:58.289328 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-91d6ac78-594e-4e6f-b4ca-66627ecdf7fd tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:58.289841 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-91d6ac78-594e-4e6f-b4ca-66627ecdf7fd tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:58.427859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-91d6ac78-594e-4e6f-b4ca-66627ecdf7fd tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:58.435779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-91d6ac78-594e-4e6f-b4ca-66627ecdf7fd tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1514 microversion: 2.1 time: 0.163174 May 25 16:11:58.436350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 263/533] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:58 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:58.518005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-87615cc4-8cb0-4380-a27a-cc605887330b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:58.518996 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-87615cc4-8cb0-4380-a27a-cc605887330b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:58.529396 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-87615cc4-8cb0-4380-a27a-cc605887330b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:58.530035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-87615cc4-8cb0-4380-a27a-cc605887330b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:58.531089 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-87615cc4-8cb0-4380-a27a-cc605887330b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:58.531513 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-87615cc4-8cb0-4380-a27a-cc605887330b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:58.582590 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c59a27db-13b8-4870-bf76-6e9684791081 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:58.583435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c59a27db-13b8-4870-bf76-6e9684791081 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:58.590332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c59a27db-13b8-4870-bf76-6e9684791081 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:58.590859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c59a27db-13b8-4870-bf76-6e9684791081 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:58.591793 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c59a27db-13b8-4870-bf76-6e9684791081 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:58.592215 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c59a27db-13b8-4870-bf76-6e9684791081 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:58.594406 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-87615cc4-8cb0-4380-a27a-cc605887330b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:58.596635 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:58.602088 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-87615cc4-8cb0-4380-a27a-cc605887330b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1293 microversion: 2.1 time: 0.091294 May 25 16:11:58.602653 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 271/534] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:58 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:58.729465 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c59a27db-13b8-4870-bf76-6e9684791081 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:58.737619 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c59a27db-13b8-4870-bf76-6e9684791081 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.158966 May 25 16:11:58.738187 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 264/535] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:58 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:11:59.059904 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-218e0c71-402b-4e3b-ae35-2f2faa6239a5 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:59.061216 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-218e0c71-402b-4e3b-ae35-2f2faa6239a5 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:59.068424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-218e0c71-402b-4e3b-ae35-2f2faa6239a5 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:59.069028 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-218e0c71-402b-4e3b-ae35-2f2faa6239a5 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:59.069868 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-218e0c71-402b-4e3b-ae35-2f2faa6239a5 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:59.070393 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-218e0c71-402b-4e3b-ae35-2f2faa6239a5 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:59.209578 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-218e0c71-402b-4e3b-ae35-2f2faa6239a5 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:59.225525 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-218e0c71-402b-4e3b-ae35-2f2faa6239a5 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1724 microversion: 2.1 time: 0.172430 May 25 16:11:59.226520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 272/536] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:59 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:59.453200 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-93f85d55-0a80-4d76-a713-1c80d8aa1633 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:59.453785 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-93f85d55-0a80-4d76-a713-1c80d8aa1633 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:59.461456 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-93f85d55-0a80-4d76-a713-1c80d8aa1633 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:59.461905 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-93f85d55-0a80-4d76-a713-1c80d8aa1633 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:59.462673 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-93f85d55-0a80-4d76-a713-1c80d8aa1633 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:59.463073 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-93f85d55-0a80-4d76-a713-1c80d8aa1633 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:59.619026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-75e886c7-7947-4cf5-a1e7-3de1a58c907b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:59.619666 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-75e886c7-7947-4cf5-a1e7-3de1a58c907b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:59.627092 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-75e886c7-7947-4cf5-a1e7-3de1a58c907b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:59.627266 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-75e886c7-7947-4cf5-a1e7-3de1a58c907b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:59.628675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-75e886c7-7947-4cf5-a1e7-3de1a58c907b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:59.629213 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-75e886c7-7947-4cf5-a1e7-3de1a58c907b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:59.675503 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-93f85d55-0a80-4d76-a713-1c80d8aa1633 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:59.683131 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-93f85d55-0a80-4d76-a713-1c80d8aa1633 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1514 microversion: 2.1 time: 0.233879 May 25 16:11:59.683707 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 265/537] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:59 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:59.709294 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-75e886c7-7947-4cf5-a1e7-3de1a58c907b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:59.716834 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-75e886c7-7947-4cf5-a1e7-3de1a58c907b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1299 microversion: 2.1 time: 0.102148 May 25 16:11:59.717430 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 273/538] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:59 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:11:59.754586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a45655d8-3f12-4a6a-88a3-bc1c7fa1c512 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:11:59.755187 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a45655d8-3f12-4a6a-88a3-bc1c7fa1c512 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:11:59.761229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a45655d8-3f12-4a6a-88a3-bc1c7fa1c512 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:59.761667 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a45655d8-3f12-4a6a-88a3-bc1c7fa1c512 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:59.762412 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a45655d8-3f12-4a6a-88a3-bc1c7fa1c512 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:59.762840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a45655d8-3f12-4a6a-88a3-bc1c7fa1c512 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:59.899453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a45655d8-3f12-4a6a-88a3-bc1c7fa1c512 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:11:59.913825 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a45655d8-3f12-4a6a-88a3-bc1c7fa1c512 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.163083 May 25 16:11:59.915033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 266/539] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:11:59 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:11:59.955129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-e1d50b3c-1c26-45c6-a904-00637126cea3 req-381bdc16-16cb-4865-8932-2c05d17229ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b6bf66-982e-4358-adf4-d5ad0c0cd061", "name": "network-vif-deleted", "tag": "aae7561e-069c-49cd-b130-6900676f3d8c"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:11:59.964018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-e1d50b3c-1c26-45c6-a904-00637126cea3 req-381bdc16-16cb-4865-8932-2c05d17229ed service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:11:59.964488 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-e1d50b3c-1c26-45c6-a904-00637126cea3 req-381bdc16-16cb-4865-8932-2c05d17229ed service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:11:59.977455 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-e1d50b3c-1c26-45c6-a904-00637126cea3 req-381bdc16-16cb-4865-8932-2c05d17229ed service nova] Creating event network-vif-deleted:aae7561e-069c-49cd-b130-6900676f3d8c for instance 46b6bf66-982e-4358-adf4-d5ad0c0cd061 on hv-cinder-84327 May 25 16:11:59.983020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-e1d50b3c-1c26-45c6-a904-00637126cea3 req-381bdc16-16cb-4865-8932-2c05d17229ed service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031758 May 25 16:11:59.984269 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 274/540] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:12:00.243384 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ed294fca-9577-486c-a725-e74a1f9bac44 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:00.244424 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ed294fca-9577-486c-a725-e74a1f9bac44 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:00.250451 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed294fca-9577-486c-a725-e74a1f9bac44 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:00.250958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed294fca-9577-486c-a725-e74a1f9bac44 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:00.251724 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed294fca-9577-486c-a725-e74a1f9bac44 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:00.252231 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed294fca-9577-486c-a725-e74a1f9bac44 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:00.397101 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ed294fca-9577-486c-a725-e74a1f9bac44 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:00.406943 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ed294fca-9577-486c-a725-e74a1f9bac44 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1724 microversion: 2.1 time: 0.167694 May 25 16:12:00.407589 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 267/541] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:00 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:00.706553 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:00.707616 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:00.718244 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:00.718695 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:00.719466 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:00.719936 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:00.734039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0340967d-e4e6-4405-b682-e3beb8a7057b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:00.734657 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0340967d-e4e6-4405-b682-e3beb8a7057b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:00.741581 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0340967d-e4e6-4405-b682-e3beb8a7057b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:00.742030 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0340967d-e4e6-4405-b682-e3beb8a7057b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:00.742803 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0340967d-e4e6-4405-b682-e3beb8a7057b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:00.743240 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0340967d-e4e6-4405-b682-e3beb8a7057b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:00.751325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:00.751773 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:00.752250 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lazy-loading 'fault' on Instance uuid 46b6bf66-982e-4358-adf4-d5ad0c0cd061 {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:12:00.797085 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:00.804670 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-29ea83c1-e6d1-4414-947f-984b281b84b5 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1308 microversion: 2.1 time: 0.106113 May 25 16:12:00.805241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 275/542] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:00 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:00.874204 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0340967d-e4e6-4405-b682-e3beb8a7057b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:00.885445 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0340967d-e4e6-4405-b682-e3beb8a7057b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.155122 May 25 16:12:00.886207 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 268/543] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:00 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:00.930905 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3f3c21a7-b0fd-4b24-aa9c-0bfcf4791621 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:00.931530 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3f3c21a7-b0fd-4b24-aa9c-0bfcf4791621 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:00.937999 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3f3c21a7-b0fd-4b24-aa9c-0bfcf4791621 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:00.938450 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3f3c21a7-b0fd-4b24-aa9c-0bfcf4791621 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:00.939213 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3f3c21a7-b0fd-4b24-aa9c-0bfcf4791621 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:00.939736 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3f3c21a7-b0fd-4b24-aa9c-0bfcf4791621 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:01.074067 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3f3c21a7-b0fd-4b24-aa9c-0bfcf4791621 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:01.082399 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3f3c21a7-b0fd-4b24-aa9c-0bfcf4791621 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.155400 May 25 16:12:01.082920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 276/544] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:00 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:01.423703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-468b354f-94b4-41dc-ad5b-822457821f8e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:01.424334 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-468b354f-94b4-41dc-ad5b-822457821f8e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:01.431136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-468b354f-94b4-41dc-ad5b-822457821f8e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:01.431585 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-468b354f-94b4-41dc-ad5b-822457821f8e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:01.432389 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-468b354f-94b4-41dc-ad5b-822457821f8e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:01.432808 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-468b354f-94b4-41dc-ad5b-822457821f8e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:01.562516 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-468b354f-94b4-41dc-ad5b-822457821f8e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:01.577716 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-468b354f-94b4-41dc-ad5b-822457821f8e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1724 microversion: 2.1 time: 0.157594 May 25 16:12:01.578696 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 269/545] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:01 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:01.822064 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:01.822638 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:01.829407 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:01.830124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:01.830902 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:01.831337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:01.864866 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:01.865407 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:01.866062 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lazy-loading 'fault' on Instance uuid 46b6bf66-982e-4358-adf4-d5ad0c0cd061 {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:12:01.904119 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e840f20e-c35f-48fb-8757-e30f410cb59b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:01.904857 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e840f20e-c35f-48fb-8757-e30f410cb59b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:01.911632 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e840f20e-c35f-48fb-8757-e30f410cb59b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:01.912183 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e840f20e-c35f-48fb-8757-e30f410cb59b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:01.913026 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e840f20e-c35f-48fb-8757-e30f410cb59b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:01.913495 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e840f20e-c35f-48fb-8757-e30f410cb59b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:01.939387 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b909d4c7d9b45b29f995268f8fac987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32433ec45854be380fcd9a9671a4ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:01.951681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-66e2fc72-ad55-4b3b-bf5d-62d02ffcab7b tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 200 len: 1308 microversion: 2.1 time: 0.133510 May 25 16:12:01.952689 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 277/546] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:01 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 1308 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:01.999444 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-805e30fb-05e4-4d4b-8e4e-6f96a94d39ce req-cd02ddaa-5eb2-4c74-8199-d3b452bfc473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45665f8b-ba12-41a5-8ba1-43b9dcd8e166", "tag": "94bc6516-bbb3-40bb-99c6-68f8fbe6c3a5"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:02.008984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-805e30fb-05e4-4d4b-8e4e-6f96a94d39ce req-cd02ddaa-5eb2-4c74-8199-d3b452bfc473 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:02.009414 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-805e30fb-05e4-4d4b-8e4e-6f96a94d39ce req-cd02ddaa-5eb2-4c74-8199-d3b452bfc473 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:02.021821 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-805e30fb-05e4-4d4b-8e4e-6f96a94d39ce req-cd02ddaa-5eb2-4c74-8199-d3b452bfc473 service nova] Creating event network-changed:94bc6516-bbb3-40bb-99c6-68f8fbe6c3a5 for instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 on hv-cinder-84327 May 25 16:12:02.027441 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-805e30fb-05e4-4d4b-8e4e-6f96a94d39ce req-cd02ddaa-5eb2-4c74-8199-d3b452bfc473 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031789 May 25 16:12:02.028087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 278/547] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:02.068297 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e840f20e-c35f-48fb-8757-e30f410cb59b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:02.076146 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e840f20e-c35f-48fb-8757-e30f410cb59b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.175755 May 25 16:12:02.076642 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 270/548] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:01 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:12:02.100640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6cef9502-8a21-4825-834c-145087421dad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:02.101385 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6cef9502-8a21-4825-834c-145087421dad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:02.108175 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6cef9502-8a21-4825-834c-145087421dad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:02.108705 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6cef9502-8a21-4825-834c-145087421dad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:02.109488 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6cef9502-8a21-4825-834c-145087421dad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:02.109926 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6cef9502-8a21-4825-834c-145087421dad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:02.126388 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:02.253457 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6cef9502-8a21-4825-834c-145087421dad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:02.261757 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6cef9502-8a21-4825-834c-145087421dad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.165640 May 25 16:12:02.262333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 279/549] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:02 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:02.595605 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-dc7ae7c2-4852-4566-aa3d-8ea1bdbef314 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:02.596557 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-dc7ae7c2-4852-4566-aa3d-8ea1bdbef314 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:02.603538 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dc7ae7c2-4852-4566-aa3d-8ea1bdbef314 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:02.604146 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dc7ae7c2-4852-4566-aa3d-8ea1bdbef314 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:02.604902 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dc7ae7c2-4852-4566-aa3d-8ea1bdbef314 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:02.605352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dc7ae7c2-4852-4566-aa3d-8ea1bdbef314 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:02.757910 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-dc7ae7c2-4852-4566-aa3d-8ea1bdbef314 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:02.766452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-dc7ae7c2-4852-4566-aa3d-8ea1bdbef314 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1730 microversion: 2.1 time: 0.174886 May 25 16:12:02.767035 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 271/550] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:02 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:02.785036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d00f1ab1-6f58-448b-8b0e-22f873e0f11f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:02.786608 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d00f1ab1-6f58-448b-8b0e-22f873e0f11f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:02.793670 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d00f1ab1-6f58-448b-8b0e-22f873e0f11f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:02.794212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d00f1ab1-6f58-448b-8b0e-22f873e0f11f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:02.795092 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d00f1ab1-6f58-448b-8b0e-22f873e0f11f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:02.795588 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d00f1ab1-6f58-448b-8b0e-22f873e0f11f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:02.926606 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d00f1ab1-6f58-448b-8b0e-22f873e0f11f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146970 May 25 16:12:02.927372 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 280/551] 10.222.0.85 () {58 vars in 1274 bytes} [Wed May 25 16:12:02 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:02.970229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:02.972465 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] [instance: 46b6bf66-982e-4358-adf4-d5ad0c0cd061] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:02.978813 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:02.979262 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:02.980064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:02.980494 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:02.996784 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] HTTP exception thrown: Instance 46b6bf66-982e-4358-adf4-d5ad0c0cd061 could not be found. May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Request method failure captured: May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 HTTP/1.1 May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlTGssKPr76j-PnXmiYtdKsCkPT8WpQHtYuFWLp1s9G4v6rlCVhu5fAQ7Pdu6sKXWHypfs3J8jo9VpWJGI38RnAyoTeL4EBAGxgOp0DpoVO8rjRF85fZ6xnSTdxkIGoKcEJz6_4uYKUdpsEomR3KGCWSRTIqycyXVPnCaBh55c7HlO8 May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: b32433ec45854be380fcd9a9671a4ce5 May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-VolumesSnapshotTestJSON-166935950 May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:12:02.999596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b32433ec45854be380fcd9a9671a4ce5", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b32433ec45854be380fcd9a9671a4ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b32433ec45854be380fcd9a9671a4ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b32433ec45854be380fcd9a9671a4ce5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-VolumesSnapshotTestJSON-166935950 May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: b32433ec45854be380fcd9a9671a4ce5 May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-166935950 May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-VolumesSnapshotTestJSON-166935950-project May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 2b909d4c7d9b45b29f995268f8fac987 May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-VolumesSnapshotTestJSON-166935950-project May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 46b6bf66-982e-4358-adf4-d5ad0c0cd061 could not be found. May 25 16:12:03.001174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '46b6bf66-982e-4358-adf4-d5ad0c0cd061'} May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b6bf66-982e-4358-adf4-d5ad0c0cd061 could not be found. May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:12:03.002039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b6bf66-982e-4358-adf4-d5ad0c0cd061 could not be found. May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b6bf66-982e-4358-adf4-d5ad0c0cd061 could not be found. May 25 16:12:03.003453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:03.007709 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] Returning 404 to user: Instance 46b6bf66-982e-4358-adf4-d5ad0c0cd061 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:12:03.007709 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7a82d5f7-6084-430b-b5dd-5664080229f4 tempest-VolumesSnapshotTestJSON-166935950 tempest-VolumesSnapshotTestJSON-166935950-project] 10.222.0.85 "GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061" status: 404 len: 111 microversion: 2.1 time: 0.038244 May 25 16:12:03.007709 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 272/552] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:02 2022] GET /compute/v2.1/servers/46b6bf66-982e-4358-adf4-d5ad0c0cd061 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:12:03.093631 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6c45a9ff-f6d2-4185-8250-aa0993797bde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:03.094499 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6c45a9ff-f6d2-4185-8250-aa0993797bde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:03.101811 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6c45a9ff-f6d2-4185-8250-aa0993797bde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:03.102379 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6c45a9ff-f6d2-4185-8250-aa0993797bde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:03.103357 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6c45a9ff-f6d2-4185-8250-aa0993797bde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:03.104198 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6c45a9ff-f6d2-4185-8250-aa0993797bde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:03.278705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-249f408e-5cb4-450f-ba7a-f1895647d29a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:03.279732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-249f408e-5cb4-450f-ba7a-f1895647d29a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:03.288880 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-249f408e-5cb4-450f-ba7a-f1895647d29a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:03.289332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-249f408e-5cb4-450f-ba7a-f1895647d29a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:03.290105 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-249f408e-5cb4-450f-ba7a-f1895647d29a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:03.295164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-249f408e-5cb4-450f-ba7a-f1895647d29a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:03.442363 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-249f408e-5cb4-450f-ba7a-f1895647d29a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:03.449952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-249f408e-5cb4-450f-ba7a-f1895647d29a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.175400 May 25 16:12:03.450505 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 273/553] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:03 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:03.483498 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6c45a9ff-f6d2-4185-8250-aa0993797bde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:03.494122 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6c45a9ff-f6d2-4185-8250-aa0993797bde tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.404546 May 25 16:12:03.494761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 281/554] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:03 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:04.432478 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-674abda5-9581-4a45-a935-be08447dd54d req-5ef92029-153f-4e16-9591-d1bb003ed229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3950b05-a514-47cb-8eee-c63d90575a10", "tag": "9dc3e056-237c-4546-af66-e3fc4e599215"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:04.441613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=4 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:04.451466 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-674abda5-9581-4a45-a935-be08447dd54d req-5ef92029-153f-4e16-9591-d1bb003ed229 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:04.451985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-674abda5-9581-4a45-a935-be08447dd54d req-5ef92029-153f-4e16-9591-d1bb003ed229 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:04.468718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3718e5be-b684-4469-a8a8-f16936edcaf6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:04.469381 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3718e5be-b684-4469-a8a8-f16936edcaf6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:04.476314 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:04.479412 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3718e5be-b684-4469-a8a8-f16936edcaf6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:04.479917 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3718e5be-b684-4469-a8a8-f16936edcaf6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:04.480219 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-674abda5-9581-4a45-a935-be08447dd54d req-5ef92029-153f-4e16-9591-d1bb003ed229 service nova] Creating event network-changed:9dc3e056-237c-4546-af66-e3fc4e599215 for instance a3950b05-a514-47cb-8eee-c63d90575a10 on hv-cinder-84327 May 25 16:12:04.480842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3718e5be-b684-4469-a8a8-f16936edcaf6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:04.481282 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3718e5be-b684-4469-a8a8-f16936edcaf6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:04.486879 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-674abda5-9581-4a45-a935-be08447dd54d req-5ef92029-153f-4e16-9591-d1bb003ed229 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057957 May 25 16:12:04.488672 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 274/555] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:04.532439 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d3a47d69-6425-487f-bd89-22d6684d324c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:04.533317 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d3a47d69-6425-487f-bd89-22d6684d324c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:04.549217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3a47d69-6425-487f-bd89-22d6684d324c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:04.549791 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3a47d69-6425-487f-bd89-22d6684d324c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:04.552343 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3a47d69-6425-487f-bd89-22d6684d324c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:04.552932 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3a47d69-6425-487f-bd89-22d6684d324c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:04.637129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3718e5be-b684-4469-a8a8-f16936edcaf6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:04.645011 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3718e5be-b684-4469-a8a8-f16936edcaf6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.181267 May 25 16:12:04.645818 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 282/556] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:04 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:04.704132 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d3a47d69-6425-487f-bd89-22d6684d324c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:04.714284 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d3a47d69-6425-487f-bd89-22d6684d324c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.204956 May 25 16:12:04.715097 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 275/557] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:04 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:12:05.666880 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cf29b36a-c25c-4f46-b043-4d19ff7db2a6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:05.668090 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cf29b36a-c25c-4f46-b043-4d19ff7db2a6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:05.676220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cf29b36a-c25c-4f46-b043-4d19ff7db2a6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:05.676677 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cf29b36a-c25c-4f46-b043-4d19ff7db2a6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:05.677453 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cf29b36a-c25c-4f46-b043-4d19ff7db2a6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:05.677890 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cf29b36a-c25c-4f46-b043-4d19ff7db2a6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:05.730613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-167843bf-35e9-4b86-9df4-fb867c9237f4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:05.731217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-167843bf-35e9-4b86-9df4-fb867c9237f4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:05.738186 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-167843bf-35e9-4b86-9df4-fb867c9237f4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:05.738634 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-167843bf-35e9-4b86-9df4-fb867c9237f4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:05.739455 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-167843bf-35e9-4b86-9df4-fb867c9237f4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:05.739999 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-167843bf-35e9-4b86-9df4-fb867c9237f4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:05.807010 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cf29b36a-c25c-4f46-b043-4d19ff7db2a6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:05.814886 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cf29b36a-c25c-4f46-b043-4d19ff7db2a6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.155064 May 25 16:12:05.815494 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 283/558] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:05 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:05.869742 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-167843bf-35e9-4b86-9df4-fb867c9237f4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:05.878143 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-167843bf-35e9-4b86-9df4-fb867c9237f4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.151371 May 25 16:12:05.878726 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 276/559] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:05 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:06.502497 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-ecd6ed10-ed1c-46bb-8f1e-8f8c048620f3 req-3a2e9b8c-da57-4812-89fd-9fdf2ec5c51c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3950b05-a514-47cb-8eee-c63d90575a10", "tag": "9dc3e056-237c-4546-af66-e3fc4e599215"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:06.505965 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:06.506655 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=8 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:06.512962 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-ecd6ed10-ed1c-46bb-8f1e-8f8c048620f3 req-3a2e9b8c-da57-4812-89fd-9fdf2ec5c51c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:06.513398 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-ecd6ed10-ed1c-46bb-8f1e-8f8c048620f3 req-3a2e9b8c-da57-4812-89fd-9fdf2ec5c51c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:06.525115 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-ecd6ed10-ed1c-46bb-8f1e-8f8c048620f3 req-3a2e9b8c-da57-4812-89fd-9fdf2ec5c51c service nova] Creating event network-changed:9dc3e056-237c-4546-af66-e3fc4e599215 for instance a3950b05-a514-47cb-8eee-c63d90575a10 on hv-cinder-84327 May 25 16:12:06.530095 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-ecd6ed10-ed1c-46bb-8f1e-8f8c048620f3 req-3a2e9b8c-da57-4812-89fd-9fdf2ec5c51c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031438 May 25 16:12:06.530733 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 284/560] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:06.836826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-33fb61cc-8591-401d-9634-982d806ac8a3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:06.837695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-33fb61cc-8591-401d-9634-982d806ac8a3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:06.848649 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-33fb61cc-8591-401d-9634-982d806ac8a3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:06.849400 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-33fb61cc-8591-401d-9634-982d806ac8a3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:06.850850 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-33fb61cc-8591-401d-9634-982d806ac8a3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:06.851582 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-33fb61cc-8591-401d-9634-982d806ac8a3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:06.895719 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-10b59d6e-8578-4d3b-8a85-8308fd7c853f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:06.896468 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-10b59d6e-8578-4d3b-8a85-8308fd7c853f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:06.903610 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10b59d6e-8578-4d3b-8a85-8308fd7c853f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:06.904084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10b59d6e-8578-4d3b-8a85-8308fd7c853f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:06.904852 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10b59d6e-8578-4d3b-8a85-8308fd7c853f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:06.905285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10b59d6e-8578-4d3b-8a85-8308fd7c853f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:06.989446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-33fb61cc-8591-401d-9634-982d806ac8a3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:06.997099 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-33fb61cc-8591-401d-9634-982d806ac8a3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1678 microversion: 2.1 time: 0.167334 May 25 16:12:06.997696 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 277/561] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:06 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:07.040620 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-10b59d6e-8578-4d3b-8a85-8308fd7c853f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:07.047960 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-10b59d6e-8578-4d3b-8a85-8308fd7c853f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.156514 May 25 16:12:07.048525 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 285/562] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:06 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:12:08.014476 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-97402ec8-c1ea-4df2-925b-155da3a914e8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:08.015661 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-97402ec8-c1ea-4df2-925b-155da3a914e8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:08.020639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3e22138c-ddd2-414c-9959-9c4a8d388d88 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:08.021738 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3e22138c-ddd2-414c-9959-9c4a8d388d88 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:08.027353 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97402ec8-c1ea-4df2-925b-155da3a914e8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.027813 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97402ec8-c1ea-4df2-925b-155da3a914e8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.028681 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97402ec8-c1ea-4df2-925b-155da3a914e8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.031206 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e22138c-ddd2-414c-9959-9c4a8d388d88 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.031596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97402ec8-c1ea-4df2-925b-155da3a914e8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.032132 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e22138c-ddd2-414c-9959-9c4a8d388d88 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.033096 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e22138c-ddd2-414c-9959-9c4a8d388d88 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.033739 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3e22138c-ddd2-414c-9959-9c4a8d388d88 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.069207 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3e22138c-ddd2-414c-9959-9c4a8d388d88 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments/99b8a5dc-ea47-403e-9aa3-862b4c7aac64" status: 200 len: 194 microversion: 2.20 time: 0.053055 May 25 16:12:08.075541 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 286/563] 10.222.0.85 () {60 vars in 1453 bytes} [Wed May 25 16:12:08 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments/99b8a5dc-ea47-403e-9aa3-862b4c7aac64 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:12:08.081647 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-141d925a-9979-4bc9-9bc2-db13cf3178be tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:08.083013 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-141d925a-9979-4bc9-9bc2-db13cf3178be tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:08.091112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-141d925a-9979-4bc9-9bc2-db13cf3178be tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.093346 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-141d925a-9979-4bc9-9bc2-db13cf3178be tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.094308 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-141d925a-9979-4bc9-9bc2-db13cf3178be tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.100591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-141d925a-9979-4bc9-9bc2-db13cf3178be tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.206432 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-97402ec8-c1ea-4df2-925b-155da3a914e8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:08.214012 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-97402ec8-c1ea-4df2-925b-155da3a914e8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1655 microversion: 2.1 time: 0.203580 May 25 16:12:08.214549 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 278/564] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:08 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1655 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:08.219467 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a249ec01-29cc-4484-bbae-504e30cbe4f4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:08.220083 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a249ec01-29cc-4484-bbae-504e30cbe4f4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:08.226627 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a249ec01-29cc-4484-bbae-504e30cbe4f4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.227165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a249ec01-29cc-4484-bbae-504e30cbe4f4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.228060 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a249ec01-29cc-4484-bbae-504e30cbe4f4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.228579 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a249ec01-29cc-4484-bbae-504e30cbe4f4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.313092 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-a249ec01-29cc-4484-bbae-504e30cbe4f4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lazy-loading 'services' on Instance uuid e80a2c16-520b-48e9-9f83-e643414a8c8e {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:12:08.330193 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-141d925a-9979-4bc9-9bc2-db13cf3178be tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:08.338903 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-141d925a-9979-4bc9-9bc2-db13cf3178be tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.261798 May 25 16:12:08.339620 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 287/565] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:08 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:08.344836 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ed72d8fd-d439-449d-81eb-de077429d48c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:08.351424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed72d8fd-d439-449d-81eb-de077429d48c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.351911 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ed72d8fd-d439-449d-81eb-de077429d48c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.378803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ed72d8fd-d439-449d-81eb-de077429d48c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Going to try to start instance {{(pid=117764) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 16:12:08.397212 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a249ec01-29cc-4484-bbae-504e30cbe4f4 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments/99b8a5dc-ea47-403e-9aa3-862b4c7aac64" status: 202 len: 0 microversion: 2.20 time: 0.181060 May 25 16:12:08.397857 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 279/566] 10.222.0.85 () {60 vars in 1456 bytes} [Wed May 25 16:12:08 2022] DELETE /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments/99b8a5dc-ea47-403e-9aa3-862b4c7aac64 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:12:08.409421 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6567c1f2-f610-449e-943c-f7c7196cd95e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:08.412570 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-6567c1f2-f610-449e-943c-f7c7196cd95e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:08.422561 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6567c1f2-f610-449e-943c-f7c7196cd95e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.423144 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6567c1f2-f610-449e-943c-f7c7196cd95e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.423967 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6567c1f2-f610-449e-943c-f7c7196cd95e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.424408 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6567c1f2-f610-449e-943c-f7c7196cd95e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.441288 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ed72d8fd-d439-449d-81eb-de077429d48c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/action" status: 202 len: 0 microversion: 2.1 time: 0.100173 May 25 16:12:08.442549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 288/567] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:12:08 2022] POST /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:12:08.452717 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9e8685da-ad0e-4221-97f3-c4125fc07f11 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:08.454201 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9e8685da-ad0e-4221-97f3-c4125fc07f11 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:08.455902 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6567c1f2-f610-449e-943c-f7c7196cd95e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053041 May 25 16:12:08.456540 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 280/568] 10.222.0.85 () {60 vars in 1342 bytes} [Wed May 25 16:12:08 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 16:12:08.464424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9e8685da-ad0e-4221-97f3-c4125fc07f11 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.464878 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9e8685da-ad0e-4221-97f3-c4125fc07f11 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.465682 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9e8685da-ad0e-4221-97f3-c4125fc07f11 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.466121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9e8685da-ad0e-4221-97f3-c4125fc07f11 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.602236 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9e8685da-ad0e-4221-97f3-c4125fc07f11 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:08.610020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9e8685da-ad0e-4221-97f3-c4125fc07f11 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1664 microversion: 2.1 time: 0.163158 May 25 16:12:08.610627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 289/569] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:08 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:08.936921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-5b796e43-cf38-4c66-8a12-efdb07779876 req-67d3029c-c646-435f-808f-66ef2c027416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45665f8b-ba12-41a5-8ba1-43b9dcd8e166", "name": "network-vif-plugged", "status": "completed", "tag": "94bc6516-bbb3-40bb-99c6-68f8fbe6c3a5"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:08.946468 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-5b796e43-cf38-4c66-8a12-efdb07779876 req-67d3029c-c646-435f-808f-66ef2c027416 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:08.947188 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-5b796e43-cf38-4c66-8a12-efdb07779876 req-67d3029c-c646-435f-808f-66ef2c027416 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:08.960813 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-5b796e43-cf38-4c66-8a12-efdb07779876 req-67d3029c-c646-435f-808f-66ef2c027416 service nova] Creating event network-vif-plugged:94bc6516-bbb3-40bb-99c6-68f8fbe6c3a5 for instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 on hv-cinder-84327 May 25 16:12:08.966175 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-5b796e43-cf38-4c66-8a12-efdb07779876 req-67d3029c-c646-435f-808f-66ef2c027416 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033947 May 25 16:12:08.967006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 281/570] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:09.360041 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f332764b-bee5-4bac-9e11-9778b0872a56 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:09.360653 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f332764b-bee5-4bac-9e11-9778b0872a56 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:09.367163 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f332764b-bee5-4bac-9e11-9778b0872a56 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.367603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f332764b-bee5-4bac-9e11-9778b0872a56 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.368398 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f332764b-bee5-4bac-9e11-9778b0872a56 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.368829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f332764b-bee5-4bac-9e11-9778b0872a56 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.468794 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4d7f2695-bccc-4303-8ddb-7186541f0289 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:09.469960 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4d7f2695-bccc-4303-8ddb-7186541f0289 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:09.472634 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:09.478016 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4d7f2695-bccc-4303-8ddb-7186541f0289 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.478566 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4d7f2695-bccc-4303-8ddb-7186541f0289 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.479409 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4d7f2695-bccc-4303-8ddb-7186541f0289 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.479942 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4d7f2695-bccc-4303-8ddb-7186541f0289 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.484526 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:09.504470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f332764b-bee5-4bac-9e11-9778b0872a56 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:09.512004 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f332764b-bee5-4bac-9e11-9778b0872a56 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.158184 May 25 16:12:09.512318 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4d7f2695-bccc-4303-8ddb-7186541f0289 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048358 May 25 16:12:09.512573 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 290/571] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:09 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:09.512878 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 282/572] 10.222.0.85 () {60 vars in 1342 bytes} [Wed May 25 16:12:09 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:12:09.574904 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e173ebcc-3983-45d6-a911-821b51c9dec1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:09.575480 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e173ebcc-3983-45d6-a911-821b51c9dec1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:09.582452 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e173ebcc-3983-45d6-a911-821b51c9dec1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.582950 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e173ebcc-3983-45d6-a911-821b51c9dec1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.583728 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e173ebcc-3983-45d6-a911-821b51c9dec1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.584199 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e173ebcc-3983-45d6-a911-821b51c9dec1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.610321 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e173ebcc-3983-45d6-a911-821b51c9dec1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:12:09.626877 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-37a361cc-e120-4912-b48a-2ddc1da351f2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:09.627652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-37a361cc-e120-4912-b48a-2ddc1da351f2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:09.635167 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-37a361cc-e120-4912-b48a-2ddc1da351f2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.635778 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-37a361cc-e120-4912-b48a-2ddc1da351f2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.636749 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-37a361cc-e120-4912-b48a-2ddc1da351f2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.637273 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-37a361cc-e120-4912-b48a-2ddc1da351f2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.698230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e173ebcc-3983-45d6-a911-821b51c9dec1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 204 len: 0 microversion: 2.20 time: 0.126554 May 25 16:12:09.698928 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 291/573] 10.222.0.85 () {60 vars in 1279 bytes} [Wed May 25 16:12:09 2022] DELETE /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 16:12:09.708024 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:09.708836 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:09.715119 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.715573 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.716389 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:09.716825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:09.779008 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-37a361cc-e120-4912-b48a-2ddc1da351f2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:09.787048 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-37a361cc-e120-4912-b48a-2ddc1da351f2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1664 microversion: 2.1 time: 0.164065 May 25 16:12:09.787623 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 283/574] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:09 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:12:09.847812 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:09.856476 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:09.858005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:09.859260 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ffd2c891-c370-4510-8be0-1f98c814a127 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.155939 May 25 16:12:09.859815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 292/575] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:09 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:12:10.529970 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a25d4769-a79e-4947-9a83-068dde08b435 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:10.530685 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a25d4769-a79e-4947-9a83-068dde08b435 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:10.537061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a25d4769-a79e-4947-9a83-068dde08b435 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:10.537516 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a25d4769-a79e-4947-9a83-068dde08b435 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:10.538392 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a25d4769-a79e-4947-9a83-068dde08b435 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:10.538822 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a25d4769-a79e-4947-9a83-068dde08b435 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:10.669777 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a25d4769-a79e-4947-9a83-068dde08b435 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:10.677746 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a25d4769-a79e-4947-9a83-068dde08b435 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.151969 May 25 16:12:10.678343 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 284/576] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:10 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:10.807568 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c935e218-7060-44d9-8601-834f6ce5acd3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:10.808478 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c935e218-7060-44d9-8601-834f6ce5acd3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:10.817580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c935e218-7060-44d9-8601-834f6ce5acd3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:10.818156 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c935e218-7060-44d9-8601-834f6ce5acd3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:10.819254 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c935e218-7060-44d9-8601-834f6ce5acd3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:10.819909 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c935e218-7060-44d9-8601-834f6ce5acd3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:10.878929 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:10.879754 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:10.886197 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:10.886749 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:10.887566 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:10.888105 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:10.951291 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c935e218-7060-44d9-8601-834f6ce5acd3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:10.958812 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c935e218-7060-44d9-8601-834f6ce5acd3 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1664 microversion: 2.1 time: 0.157135 May 25 16:12:10.959377 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 293/577] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:10 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:11.018053 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:11.026046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:11.027544 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:11.028703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ce8b45a6-f60e-441e-baad-9203cec721e6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.153811 May 25 16:12:11.029264 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 285/578] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:10 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:11.694585 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-be88172b-e476-4f0d-89f2-32da927f9ae0 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:11.695298 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-be88172b-e476-4f0d-89f2-32da927f9ae0 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:11.701867 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-be88172b-e476-4f0d-89f2-32da927f9ae0 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:11.702392 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-be88172b-e476-4f0d-89f2-32da927f9ae0 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:11.703168 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-be88172b-e476-4f0d-89f2-32da927f9ae0 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:11.703602 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-be88172b-e476-4f0d-89f2-32da927f9ae0 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:11.723959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:11.855518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-be88172b-e476-4f0d-89f2-32da927f9ae0 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:11.863070 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-be88172b-e476-4f0d-89f2-32da927f9ae0 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.172381 May 25 16:12:11.863640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 294/579] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:11 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:11.980063 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d8e5a47c-9864-48f9-81dd-e9de74d105c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:11.981073 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d8e5a47c-9864-48f9-81dd-e9de74d105c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:11.992365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d8e5a47c-9864-48f9-81dd-e9de74d105c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:11.993110 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d8e5a47c-9864-48f9-81dd-e9de74d105c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:11.994371 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d8e5a47c-9864-48f9-81dd-e9de74d105c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:11.995088 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d8e5a47c-9864-48f9-81dd-e9de74d105c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:12.047267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:12.048019 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:12.054474 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:12.054928 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:12.055696 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:12.056173 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:12.127022 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d8e5a47c-9864-48f9-81dd-e9de74d105c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:12.134842 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d8e5a47c-9864-48f9-81dd-e9de74d105c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1668 microversion: 2.1 time: 0.161284 May 25 16:12:12.135452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 286/580] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:11 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:12.193470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:12.204490 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:12.205980 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:12.207124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c14002ae-ba93-45ef-81e3-211b1473265e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.163839 May 25 16:12:12.207680 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 295/581] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:12 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:12.884712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1c15ba4f-d1bd-4fde-bd95-61b89cea9814 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:12.885324 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1c15ba4f-d1bd-4fde-bd95-61b89cea9814 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:12.891991 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1c15ba4f-d1bd-4fde-bd95-61b89cea9814 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:12.892441 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1c15ba4f-d1bd-4fde-bd95-61b89cea9814 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:12.893197 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1c15ba4f-d1bd-4fde-bd95-61b89cea9814 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:12.893624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1c15ba4f-d1bd-4fde-bd95-61b89cea9814 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:13.030536 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1c15ba4f-d1bd-4fde-bd95-61b89cea9814 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:13.038507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1c15ba4f-d1bd-4fde-bd95-61b89cea9814 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.157782 May 25 16:12:13.039073 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 287/582] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:12 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:13.229791 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:13.230598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:13.242062 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:13.242775 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:13.244162 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:13.244889 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:13.380129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:13.388567 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:13.390435 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:13.391582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-164f047b-bfaa-499e-bb3b-4418aa03ebcb tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.168499 May 25 16:12:13.392178 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 296/583] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:13 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:14.059760 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-361623a9-437e-484d-8547-cd2a064b84f5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:14.060649 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-361623a9-437e-484d-8547-cd2a064b84f5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:14.068712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-361623a9-437e-484d-8547-cd2a064b84f5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:14.069210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-361623a9-437e-484d-8547-cd2a064b84f5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:14.070081 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-361623a9-437e-484d-8547-cd2a064b84f5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:14.070532 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-361623a9-437e-484d-8547-cd2a064b84f5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:14.210751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-361623a9-437e-484d-8547-cd2a064b84f5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:14.218539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-361623a9-437e-484d-8547-cd2a064b84f5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1367 microversion: 2.1 time: 0.165345 May 25 16:12:14.219104 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 288/584] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:14 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:14.410523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:14.411111 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:14.418074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:14.418522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:14.419285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:14.419717 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:14.565339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:14.577884 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:14.579518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:14.580780 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6bbc9165-43a4-4acd-969a-8df711a8e05c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.174263 May 25 16:12:14.581315 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 297/585] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:14 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:15.236709 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-488f21ce-1f5c-4ffd-9e73-c912a2070a64 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:15.237346 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-488f21ce-1f5c-4ffd-9e73-c912a2070a64 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:15.244398 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-488f21ce-1f5c-4ffd-9e73-c912a2070a64 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:15.244843 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-488f21ce-1f5c-4ffd-9e73-c912a2070a64 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:15.245603 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-488f21ce-1f5c-4ffd-9e73-c912a2070a64 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:15.246049 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-488f21ce-1f5c-4ffd-9e73-c912a2070a64 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:15.388851 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-488f21ce-1f5c-4ffd-9e73-c912a2070a64 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:15.397407 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-488f21ce-1f5c-4ffd-9e73-c912a2070a64 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1557 microversion: 2.1 time: 0.165452 May 25 16:12:15.397984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 289/586] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:15 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:15.413893 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a49a90d3-fb25-433f-9d95-d2fbf3eee03a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:15.414414 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a49a90d3-fb25-433f-9d95-d2fbf3eee03a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:15.421102 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a49a90d3-fb25-433f-9d95-d2fbf3eee03a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:15.421524 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a49a90d3-fb25-433f-9d95-d2fbf3eee03a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:15.422274 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a49a90d3-fb25-433f-9d95-d2fbf3eee03a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:15.422699 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a49a90d3-fb25-433f-9d95-d2fbf3eee03a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:15.509007 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a49a90d3-fb25-433f-9d95-d2fbf3eee03a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098593 May 25 16:12:15.509885 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 298/587] 10.222.0.85 () {58 vars in 1274 bytes} [Wed May 25 16:12:15 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:15.598889 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:15.599527 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:15.606123 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:15.606571 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:15.607372 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:15.607807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:15.741975 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:15.750363 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:15.751859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:15.753052 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5c9ccbe7-3814-4436-8197-6cd30e8a947b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1724 microversion: 2.20 time: 0.158136 May 25 16:12:15.753632 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 290/588] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:15 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:16.773017 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:16.773631 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:16.780125 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:16.780569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:16.781323 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:16.781752 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:16.891870 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:16.900090 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:16.901591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:16.902747 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-af52cbe9-0fb6-4094-a9b0-50ad26f81078 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1657 microversion: 2.20 time: 0.134403 May 25 16:12:16.903294 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 299/589] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:16 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1657 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:17.404958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-b07b9c70-1af2-4fce-bd8b-b2a2cab9b7e6 req-77a2ccaa-c68d-4cec-a7b3-6fc6c0cfb50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45665f8b-ba12-41a5-8ba1-43b9dcd8e166", "tag": "94bc6516-bbb3-40bb-99c6-68f8fbe6c3a5"}, {"server_uuid": "e80a2c16-520b-48e9-9f83-e643414a8c8e", "name": "network-vif-deleted", "tag": "4bf95a69-e3e3-4ef3-aeeb-8e9c69077969"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:17.426263 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-b07b9c70-1af2-4fce-bd8b-b2a2cab9b7e6 req-77a2ccaa-c68d-4cec-a7b3-6fc6c0cfb50c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:17.426959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-b07b9c70-1af2-4fce-bd8b-b2a2cab9b7e6 req-77a2ccaa-c68d-4cec-a7b3-6fc6c0cfb50c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:17.446471 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-b07b9c70-1af2-4fce-bd8b-b2a2cab9b7e6 req-77a2ccaa-c68d-4cec-a7b3-6fc6c0cfb50c service nova] Creating event network-changed:94bc6516-bbb3-40bb-99c6-68f8fbe6c3a5 for instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 on hv-cinder-84327 May 25 16:12:17.447161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-b07b9c70-1af2-4fce-bd8b-b2a2cab9b7e6 req-77a2ccaa-c68d-4cec-a7b3-6fc6c0cfb50c service nova] Creating event network-vif-deleted:4bf95a69-e3e3-4ef3-aeeb-8e9c69077969 for instance e80a2c16-520b-48e9-9f83-e643414a8c8e on hv-cinder-84327 May 25 16:12:17.472006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-b07b9c70-1af2-4fce-bd8b-b2a2cab9b7e6 req-77a2ccaa-c68d-4cec-a7b3-6fc6c0cfb50c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068267 May 25 16:12:17.477443 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 291/590] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:17.922093 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:17.922093 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:17.928782 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:17.929547 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:17.930541 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:17.931190 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:17.966195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:17.966965 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:17.967665 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lazy-loading 'fault' on Instance uuid e80a2c16-520b-48e9-9f83-e643414a8c8e {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:12:18.047068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:18.056059 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:18.058986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:18.060282 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-265781ce-ed79-475d-959a-58b1e77c89ab tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 200 len: 1372 microversion: 2.20 time: 0.142790 May 25 16:12:18.061447 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 300/591] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:17 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 1372 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:19.084739 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:19.085754 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:19.096722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:19.097470 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:19.098738 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:19.099475 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:19.118150 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] HTTP exception thrown: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Request method failure captured: May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e HTTP/1.1 May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRfE43-QDxEc85RsAinp1XSohF8nDAtmkYOSPKPYoqGHL2-QM2vUfeqxBmNzpnVtvlRdrJ8XZ-ryQt470EEASTj6gWZgx5UhVaBrNXp9Xo__Px6AsRj8cn8zPbhEcSIyw5IZYNIOAm3nMyHF8hM671merzr857Vwp7QSbwxKSGxog8 May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: feb4d81e1722439591065849449aeb18 May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:12:19.120001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_feb4d81e1722439591065849449aeb18", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/feb4d81e1722439591065849449aeb18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: feb4d81e1722439591065849449aeb18 May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: be5c51fdd2fe4159a83a560dc074da6b May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:12:19.121606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': 'e80a2c16-520b-48e9-9f83-e643414a8c8e'} May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:12:19.122488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:12:19.124000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:12:19.125524 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Returning 404 to user: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:12:19.125524 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6924afd9-c5d6-49c2-a501-9929a2eb0540 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 404 len: 111 microversion: 2.20 time: 0.044207 May 25 16:12:19.125524 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 292/592] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:19 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 16:12:19.130397 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e00fcb9a-319c-4ae0-99f8-cdd3c0bccdea tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '.version_select at 0x7fbae3e1fc10>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:19.151789 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e00fcb9a-319c-4ae0-99f8-cdd3c0bccdea tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002790312" status: 204 len: 0 microversion: 2.20 time: 0.025273 May 25 16:12:19.152366 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 301/593] 10.222.0.85 () {60 vars in 1261 bytes} [Wed May 25 16:12:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002790312 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 16:12:19.802675 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-39338ca2-df8e-4d64-901c-c5d54a3c812b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'create', calling method: .version_select at 0x7fbae3fc3c10>, body: {"keypair": {"name": "tempest-keypair-1421513543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmOdZaVZ9GzLygyrPPGWwJaLc0LOsp+asT6WzAFtauR1Uz6nHFA1NMH89xjuhBa0PPuNgQKZebwTAprWHR+mIneuDtiGvc4abnr1rso0dvnqLc2ariOP8XrZKIn2cs6iQ=="}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:19.816568 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-39338ca2-df8e-4d64-901c-c5d54a3c812b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Getting quotas for project feb4d81e1722439591065849449aeb18. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:12:19.820449 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-39338ca2-df8e-4d64-901c-c5d54a3c812b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Getting quotas for user be5c51fdd2fe4159a83a560dc074da6b and project feb4d81e1722439591065849449aeb18. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:12:19.843094 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-39338ca2-df8e-4d64-901c-c5d54a3c812b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044186 May 25 16:12:19.843689 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 293/594] 10.222.0.85 () {62 vars in 1199 bytes} [Wed May 25 16:12:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 16:12:21.183203 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-193473052", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a65193d0-d741-4333-90e3-e22c40adb85c"}], "security_groups": [{"name": "tempest-securitygroup--1928280788"}], "key_name": "tempest-keypair-1421513543", "user_data": "}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:21.293214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.network.neutron [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] validate_networks() for [('a65193d0-d741-4333-90e3-e22c40adb85c', None, None, None, None, None)] {{(pid=117764) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:12:21.668110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Flavor limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:12:21.668535 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Image limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:12:21.669007 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Flavor pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:12:21.669436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Image pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:12:21.669984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:12:21.680037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:21.680491 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:21.681173 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:21.681609 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:21.701070 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Getting quotas for project feb4d81e1722439591065849449aeb18. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:12:21.705135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Getting quotas for user be5c51fdd2fe4159a83a560dc074da6b and project feb4d81e1722439591065849449aeb18. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:12:21.716270 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Going to run 1 instances... {{(pid=117764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:12:21.718611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:12:21.763636 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a2a35fe0-a2f9-499f-b0fe-5cfbaf0edcef tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.584895 May 25 16:12:21.764633 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 302/595] 10.222.0.85 () {62 vars in 1187 bytes} [Wed May 25 16:12:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 16:12:21.775289 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5d4237f1-545c-4646-9144-f9cc5a9ff7e9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:21.775924 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5d4237f1-545c-4646-9144-f9cc5a9ff7e9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:21.834115 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5d4237f1-545c-4646-9144-f9cc5a9ff7e9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:21.842783 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5d4237f1-545c-4646-9144-f9cc5a9ff7e9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:21.844771 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5d4237f1-545c-4646-9144-f9cc5a9ff7e9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:21.846406 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5d4237f1-545c-4646-9144-f9cc5a9ff7e9 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1281 microversion: 2.20 time: 0.075316 May 25 16:12:21.847139 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 294/596] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:21 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:22.868005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:22.869395 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:22.877952 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:22.878402 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:22.879155 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:22.879790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:23.101700 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:23.110233 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:23.112398 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:23.113164 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e0c37871-b456-4350-abe7-64ee4b924c61 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1351 microversion: 2.20 time: 0.249436 May 25 16:12:23.113890 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 303/597] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:22 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1351 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:12:24.131505 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:24.132140 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:24.139864 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:24.140346 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:24.141149 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:24.141596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:24.281557 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:24.291880 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:24.294351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:24.296222 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c5b5acee-1fee-414b-a332-c49743ada340 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1407 microversion: 2.20 time: 0.168533 May 25 16:12:24.297025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 295/598] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:24 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:24.441458 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-4202898d-5e56-48a8-ab60-6a12cbcf7033 req-5116c82a-d38f-453d-8274-1a82216a5de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3262238-f19e-4c85-b637-99459fd0e59c", "tag": "1800f2a7-7112-4dbc-b1d8-94b717a81abe"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:24.450317 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-4202898d-5e56-48a8-ab60-6a12cbcf7033 req-5116c82a-d38f-453d-8274-1a82216a5de9 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:24.450759 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-4202898d-5e56-48a8-ab60-6a12cbcf7033 req-5116c82a-d38f-453d-8274-1a82216a5de9 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:24.478247 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-4202898d-5e56-48a8-ab60-6a12cbcf7033 req-5116c82a-d38f-453d-8274-1a82216a5de9 service nova] Creating event network-changed:1800f2a7-7112-4dbc-b1d8-94b717a81abe for instance a3262238-f19e-4c85-b637-99459fd0e59c on hv-cinder-84327 May 25 16:12:24.483699 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-4202898d-5e56-48a8-ab60-6a12cbcf7033 req-5116c82a-d38f-453d-8274-1a82216a5de9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045993 May 25 16:12:24.484874 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 304/599] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:25.315859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:25.316498 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:25.323412 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:25.323858 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:25.324650 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:25.325082 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:25.453924 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:25.462365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:25.463874 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:25.464993 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9e69295b-2fc6-4398-94fd-8274b0052758 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1407 microversion: 2.20 time: 0.153105 May 25 16:12:25.465558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 296/600] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:25 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:26.484585 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:26.485267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:26.492118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:26.492579 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:26.493350 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:26.493787 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:26.655449 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:26.663681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:26.665561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:26.666941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f09e9126-da5c-47f7-a685-3fcbca27f7d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1407 microversion: 2.20 time: 0.187543 May 25 16:12:26.667558 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 305/601] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:26 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:27.687096 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:27.687972 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:27.695196 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:27.695646 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:27.696443 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:27.696879 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:27.826365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:27.834744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:27.836280 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:27.837390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-801d49d3-8dd3-4f76-b4a3-8c33c52f63b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1407 microversion: 2.20 time: 0.154908 May 25 16:12:27.837965 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 297/602] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:27 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:28.858544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:28.859313 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:28.866132 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:28.866585 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:28.867366 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:28.867807 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:28.996229 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:29.004467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:29.006012 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:29.007121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-bc907b57-71e0-4dcc-8c37-5fdd5e4758be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1407 microversion: 2.20 time: 0.155097 May 25 16:12:29.007684 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 306/603] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:28 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:30.030274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:30.031032 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:30.038602 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:30.039091 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:30.039989 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:30.040473 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:30.179293 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:30.187599 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:30.189135 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:30.190240 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-be903694-640e-457e-b8c2-f4076ca9bebf tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1407 microversion: 2.20 time: 0.166983 May 25 16:12:30.190801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 298/604] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:30 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:31.037844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-d73033c6-b874-4b58-b269-44b88df769a1 req-c94d8c73-0c6c-416e-b637-4b6640fafb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3262238-f19e-4c85-b637-99459fd0e59c", "name": "network-vif-plugged", "status": "completed", "tag": "1800f2a7-7112-4dbc-b1d8-94b717a81abe"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:31.046810 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-d73033c6-b874-4b58-b269-44b88df769a1 req-c94d8c73-0c6c-416e-b637-4b6640fafb6e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:31.047247 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-d73033c6-b874-4b58-b269-44b88df769a1 req-c94d8c73-0c6c-416e-b637-4b6640fafb6e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:31.058512 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-d73033c6-b874-4b58-b269-44b88df769a1 req-c94d8c73-0c6c-416e-b637-4b6640fafb6e service nova] Creating event network-vif-plugged:1800f2a7-7112-4dbc-b1d8-94b717a81abe for instance a3262238-f19e-4c85-b637-99459fd0e59c on hv-cinder-84327 May 25 16:12:31.063316 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-d73033c6-b874-4b58-b269-44b88df769a1 req-c94d8c73-0c6c-416e-b637-4b6640fafb6e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029175 May 25 16:12:31.063931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 307/605] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:31.211054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:31.211629 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:31.219661 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:31.220216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:31.220983 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:31.221421 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:31.355776 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:31.368449 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:31.370507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:31.372218 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-79f712ed-cbf9-4868-8068-2995ae5a80b5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1407 microversion: 2.20 time: 0.166707 May 25 16:12:31.373013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 299/606] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:31 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:32.390611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:32.391935 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=6 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:32.397422 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:32.398269 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:32.407041 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:32.407589 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:32.408551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:32.409086 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:32.542392 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:32.550805 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:32.552325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:32.553415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0ba6cbe4-8de1-4fe8-b70f-39a3a0397fc3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1407 microversion: 2.20 time: 0.164964 May 25 16:12:32.553969 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 308/607] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:32 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:33.574695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:33.575510 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:33.578667 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:33.588669 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:33.589401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:33.590632 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:33.591345 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:33.731637 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:33.740309 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:33.741801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:33.742958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9fd612d8-ce8b-452e-a880-f858f3867eb5 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1600 microversion: 2.20 time: 0.174858 May 25 16:12:33.743516 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 300/608] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:12:33 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:12:33.763732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-06984b17-0ed0-4ef8-bbd8-1693dafd98f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:33.764493 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-06984b17-0ed0-4ef8-bbd8-1693dafd98f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:33.771922 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-06984b17-0ed0-4ef8-bbd8-1693dafd98f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:33.772371 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-06984b17-0ed0-4ef8-bbd8-1693dafd98f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:33.773137 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-06984b17-0ed0-4ef8-bbd8-1693dafd98f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:33.773571 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-06984b17-0ed0-4ef8-bbd8-1693dafd98f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:33.864814 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-06984b17-0ed0-4ef8-bbd8-1693dafd98f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107227 May 25 16:12:33.865680 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 309/609] 10.222.0.85 () {60 vars in 1315 bytes} [Wed May 25 16:12:33 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 16:12:34.805776 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-0cbba11a-02a7-4073-9ee2-d608d770bb64 req-d091b25f-5b5d-4119-a096-c45a7b0a0bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3262238-f19e-4c85-b637-99459fd0e59c", "tag": "1800f2a7-7112-4dbc-b1d8-94b717a81abe"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:34.814440 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-0cbba11a-02a7-4073-9ee2-d608d770bb64 req-d091b25f-5b5d-4119-a096-c45a7b0a0bae service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:34.814883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-0cbba11a-02a7-4073-9ee2-d608d770bb64 req-d091b25f-5b5d-4119-a096-c45a7b0a0bae service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:34.826887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-0cbba11a-02a7-4073-9ee2-d608d770bb64 req-d091b25f-5b5d-4119-a096-c45a7b0a0bae service nova] Creating event network-changed:1800f2a7-7112-4dbc-b1d8-94b717a81abe for instance a3262238-f19e-4c85-b637-99459fd0e59c on hv-cinder-84327 May 25 16:12:34.831999 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-0cbba11a-02a7-4073-9ee2-d608d770bb64 req-d091b25f-5b5d-4119-a096-c45a7b0a0bae service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030013 May 25 16:12:34.832802 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 301/610] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:45.403641 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:45.404413 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=73 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:45.408994 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e1a9ea34-af02-4b30-9295-6df87088d884 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:45.409485 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e1a9ea34-af02-4b30-9295-6df87088d884 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:45.417803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e1a9ea34-af02-4b30-9295-6df87088d884 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:45.418395 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e1a9ea34-af02-4b30-9295-6df87088d884 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:45.419157 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e1a9ea34-af02-4b30-9295-6df87088d884 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:45.419597 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e1a9ea34-af02-4b30-9295-6df87088d884 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:45.515425 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-e1a9ea34-af02-4b30-9295-6df87088d884 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lazy-loading 'services' on Instance uuid a3950b05-a514-47cb-8eee-c63d90575a10 {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:12:45.600334 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e1a9ea34-af02-4b30-9295-6df87088d884 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments/5bd8486c-19f1-45ce-a4d3-1dccc8828c60" status: 202 len: 0 microversion: 2.1 time: 0.197878 May 25 16:12:45.601236 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 310/611] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:12:45 2022] DELETE /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments/5bd8486c-19f1-45ce-a4d3-1dccc8828c60 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:12:45.611996 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-95c1fad5-0849-4a23-9e9f-0d8b521206e1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:45.613017 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-95c1fad5-0849-4a23-9e9f-0d8b521206e1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:45.615376 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:45.616068 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=95 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:12:45.622267 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-95c1fad5-0849-4a23-9e9f-0d8b521206e1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:45.622718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-95c1fad5-0849-4a23-9e9f-0d8b521206e1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:45.623468 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-95c1fad5-0849-4a23-9e9f-0d8b521206e1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:45.623964 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-95c1fad5-0849-4a23-9e9f-0d8b521206e1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:45.656199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-95c1fad5-0849-4a23-9e9f-0d8b521206e1 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050363 May 25 16:12:45.656820 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 302/612] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:12:45 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:46.670104 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-16551298-6bd2-4204-aeff-898e7a4151d9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:46.671101 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-16551298-6bd2-4204-aeff-898e7a4151d9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:46.677986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-16551298-6bd2-4204-aeff-898e7a4151d9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:46.678435 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-16551298-6bd2-4204-aeff-898e7a4151d9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:46.679193 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-16551298-6bd2-4204-aeff-898e7a4151d9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:46.679628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-16551298-6bd2-4204-aeff-898e7a4151d9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:46.708289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-16551298-6bd2-4204-aeff-898e7a4151d9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042964 May 25 16:12:46.708829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 311/613] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:12:46 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:12:46.788474 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6de37ed9-2930-4818-b637-5c73444ca25e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:46.789069 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-6de37ed9-2930-4818-b637-5c73444ca25e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:46.798487 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6de37ed9-2930-4818-b637-5c73444ca25e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:46.798931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6de37ed9-2930-4818-b637-5c73444ca25e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:46.799710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6de37ed9-2930-4818-b637-5c73444ca25e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:46.800171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6de37ed9-2930-4818-b637-5c73444ca25e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:46.826411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-6de37ed9-2930-4818-b637-5c73444ca25e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Going to try to terminate instance {{(pid=117763) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:12:46.911563 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6de37ed9-2930-4818-b637-5c73444ca25e tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 204 len: 0 microversion: 2.1 time: 0.129145 May 25 16:12:46.912192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 303/614] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:12:46 2022] DELETE /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:12:46.921055 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-85e82c2b-2b53-4e12-becf-2889da35bd78 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:46.921600 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-85e82c2b-2b53-4e12-becf-2889da35bd78 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:46.928192 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-85e82c2b-2b53-4e12-becf-2889da35bd78 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:46.928644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-85e82c2b-2b53-4e12-becf-2889da35bd78 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:46.929408 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-85e82c2b-2b53-4e12-becf-2889da35bd78 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:46.929850 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-85e82c2b-2b53-4e12-becf-2889da35bd78 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:47.064254 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-85e82c2b-2b53-4e12-becf-2889da35bd78 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:47.072145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-85e82c2b-2b53-4e12-becf-2889da35bd78 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1690 microversion: 2.1 time: 0.155509 May 25 16:12:47.072712 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 312/615] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:46 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:48.094389 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-99b56703-b36d-421a-9201-ed965ea0af26 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:48.095406 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-99b56703-b36d-421a-9201-ed965ea0af26 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:48.106381 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-99b56703-b36d-421a-9201-ed965ea0af26 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:48.107120 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-99b56703-b36d-421a-9201-ed965ea0af26 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:48.108455 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-99b56703-b36d-421a-9201-ed965ea0af26 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:48.109192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-99b56703-b36d-421a-9201-ed965ea0af26 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:48.248010 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-99b56703-b36d-421a-9201-ed965ea0af26 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:48.256055 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-99b56703-b36d-421a-9201-ed965ea0af26 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1690 microversion: 2.1 time: 0.168879 May 25 16:12:48.256632 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 304/616] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:48 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:49.279369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a5466182-137d-495c-95f4-0328ba8e3e8f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:49.280228 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a5466182-137d-495c-95f4-0328ba8e3e8f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:49.289787 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a5466182-137d-495c-95f4-0328ba8e3e8f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:49.290240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a5466182-137d-495c-95f4-0328ba8e3e8f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:49.291016 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a5466182-137d-495c-95f4-0328ba8e3e8f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:49.291470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a5466182-137d-495c-95f4-0328ba8e3e8f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:49.442851 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a5466182-137d-495c-95f4-0328ba8e3e8f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:49.452491 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a5466182-137d-495c-95f4-0328ba8e3e8f tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1690 microversion: 2.1 time: 0.180833 May 25 16:12:49.453124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 313/617] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:49 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1690 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:50.474185 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9176a0d2-20f2-4342-bd63-a9a25ac95452 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:50.475222 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9176a0d2-20f2-4342-bd63-a9a25ac95452 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:50.486116 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9176a0d2-20f2-4342-bd63-a9a25ac95452 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:50.486806 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9176a0d2-20f2-4342-bd63-a9a25ac95452 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:50.487567 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9176a0d2-20f2-4342-bd63-a9a25ac95452 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:50.488043 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9176a0d2-20f2-4342-bd63-a9a25ac95452 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:50.849101 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9176a0d2-20f2-4342-bd63-a9a25ac95452 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:50.861043 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9176a0d2-20f2-4342-bd63-a9a25ac95452 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1690 microversion: 2.1 time: 0.393086 May 25 16:12:50.861784 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 305/618] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:50 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1690 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:51.886939 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3c191fce-93b8-4ba1-aded-194d710dab2d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:51.887847 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3c191fce-93b8-4ba1-aded-194d710dab2d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:51.894906 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3c191fce-93b8-4ba1-aded-194d710dab2d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:51.895357 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3c191fce-93b8-4ba1-aded-194d710dab2d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:51.896186 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3c191fce-93b8-4ba1-aded-194d710dab2d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:51.896623 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3c191fce-93b8-4ba1-aded-194d710dab2d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:52.173253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3c191fce-93b8-4ba1-aded-194d710dab2d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:52.181268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3c191fce-93b8-4ba1-aded-194d710dab2d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 200 len: 1690 microversion: 2.1 time: 0.298415 May 25 16:12:52.182019 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 314/619] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:51 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 1690 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:52.459523 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-3e4f439b-33ed-465b-9477-e03bfa65a13d req-e1127bd6-cd50-4a97-ab81-de848a052c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3950b05-a514-47cb-8eee-c63d90575a10", "name": "network-vif-deleted", "tag": "9dc3e056-237c-4546-af66-e3fc4e599215"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:52.473537 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-3e4f439b-33ed-465b-9477-e03bfa65a13d req-e1127bd6-cd50-4a97-ab81-de848a052c66 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:52.473987 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-3e4f439b-33ed-465b-9477-e03bfa65a13d req-e1127bd6-cd50-4a97-ab81-de848a052c66 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:52.500720 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-3e4f439b-33ed-465b-9477-e03bfa65a13d req-e1127bd6-cd50-4a97-ab81-de848a052c66 service nova] Creating event network-vif-deleted:9dc3e056-237c-4546-af66-e3fc4e599215 for instance a3950b05-a514-47cb-8eee-c63d90575a10 on hv-cinder-84327 May 25 16:12:52.507672 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-3e4f439b-33ed-465b-9477-e03bfa65a13d req-e1127bd6-cd50-4a97-ab81-de848a052c66 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052608 May 25 16:12:52.517462 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 306/620] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:12:53.198359 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:53.199197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: a3950b05-a514-47cb-8eee-c63d90575a10] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:53.206145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:53.206664 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:53.207518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:53.208079 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:53.222482 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] HTTP exception thrown: Instance a3950b05-a514-47cb-8eee-c63d90575a10 could not be found. May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Request method failure captured: May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 HTTP/1.1 May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRflM6mHDm1IBYk5QaFi8bNjnvFMogN6K5xhr0eF8qcFq4HnvnAwua1TzxRwkhZrxQgnNUGLSd59qg-4sCGheYS3-r_aF3j2JLouc0h15X9XI1GCCUOHxQjrZ03NCFul-f6dXb6yj03zJ8KDl-0VtoQLd6EKr99XEa8_V75b8Gqj1M May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:12:53.224326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7733d8b5059433eb18dc6b174eb9533", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: d0427d9cce40423185a40df61c3617a6 May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance a3950b05-a514-47cb-8eee-c63d90575a10 could not be found. May 25 16:12:53.225604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'a3950b05-a514-47cb-8eee-c63d90575a10'} May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3950b05-a514-47cb-8eee-c63d90575a10 could not be found. May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:12:53.226363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3950b05-a514-47cb-8eee-c63d90575a10 could not be found. May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3950b05-a514-47cb-8eee-c63d90575a10 could not be found. May 25 16:12:53.227561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:12:53.228703 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Returning 404 to user: Instance a3950b05-a514-47cb-8eee-c63d90575a10 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:12:53.228703 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-00926a07-b245-4777-898d-2b8c03494d2b tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10" status: 404 len: 111 microversion: 2.1 time: 0.031243 May 25 16:12:53.228703 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 315/621] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:53 2022] GET /compute/v2.1/servers/a3950b05-a514-47cb-8eee-c63d90575a10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:12:53.234998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d4890607-8c24-4ae9-8170-3aea2c15dd0c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '.version_select at 0x7fbae3e57040>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:53.253575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d4890607-8c24-4ae9-8170-3aea2c15dd0c tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082148837" status: 202 len: 0 microversion: 2.1 time: 0.022650 May 25 16:12:53.254343 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 307/622] 10.222.0.85 () {58 vars in 1220 bytes} [Wed May 25 16:12:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082148837 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:12:53.633285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9ad9bb09-0420-44fe-85c6-a908ad373830 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:53.634352 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9ad9bb09-0420-44fe-85c6-a908ad373830 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:53.640856 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ad9bb09-0420-44fe-85c6-a908ad373830 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:53.641304 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ad9bb09-0420-44fe-85c6-a908ad373830 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:53.642066 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ad9bb09-0420-44fe-85c6-a908ad373830 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:53.642499 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ad9bb09-0420-44fe-85c6-a908ad373830 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:53.680208 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9ad9bb09-0420-44fe-85c6-a908ad373830 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050803 May 25 16:12:53.681433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 316/623] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:12:53 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:12:53.743153 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9ffaa738-f0e5-40c6-8cf3-f205d5230749 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:53.743936 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9ffaa738-f0e5-40c6-8cf3-f205d5230749 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:53.750425 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9ffaa738-f0e5-40c6-8cf3-f205d5230749 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:53.750866 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9ffaa738-f0e5-40c6-8cf3-f205d5230749 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:53.751663 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9ffaa738-f0e5-40c6-8cf3-f205d5230749 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:53.752116 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9ffaa738-f0e5-40c6-8cf3-f205d5230749 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:53.783690 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9ffaa738-f0e5-40c6-8cf3-f205d5230749 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Going to try to terminate instance {{(pid=117763) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:12:53.861445 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9ffaa738-f0e5-40c6-8cf3-f205d5230749 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 204 len: 0 microversion: 2.1 time: 0.123119 May 25 16:12:53.862031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 308/624] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:12:53 2022] DELETE /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:12:53.870150 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-14a930e0-d655-4ece-b996-e967dc0c69c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:53.870761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-14a930e0-d655-4ece-b996-e967dc0c69c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:53.876878 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14a930e0-d655-4ece-b996-e967dc0c69c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:53.877325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14a930e0-d655-4ece-b996-e967dc0c69c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:53.878109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14a930e0-d655-4ece-b996-e967dc0c69c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:53.880381 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-14a930e0-d655-4ece-b996-e967dc0c69c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:54.011867 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-14a930e0-d655-4ece-b996-e967dc0c69c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:54.020150 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-14a930e0-d655-4ece-b996-e967dc0c69c2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1674 microversion: 2.1 time: 0.153810 May 25 16:12:54.020675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 317/625] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:53 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:55.038055 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5b32f9ca-3c74-4cb7-ad96-5e3c9edf77f7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:55.038764 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5b32f9ca-3c74-4cb7-ad96-5e3c9edf77f7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:55.045143 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5b32f9ca-3c74-4cb7-ad96-5e3c9edf77f7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:55.045592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5b32f9ca-3c74-4cb7-ad96-5e3c9edf77f7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:55.046321 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5b32f9ca-3c74-4cb7-ad96-5e3c9edf77f7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:55.046741 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5b32f9ca-3c74-4cb7-ad96-5e3c9edf77f7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:55.179119 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5b32f9ca-3c74-4cb7-ad96-5e3c9edf77f7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:55.186706 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5b32f9ca-3c74-4cb7-ad96-5e3c9edf77f7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1674 microversion: 2.1 time: 0.153077 May 25 16:12:55.187366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 309/626] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:55 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:56.168702 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a1dc4d98-c589-4ee0-be5f-706ee0a65be6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:56.169211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a1dc4d98-c589-4ee0-be5f-706ee0a65be6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:56.175898 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a1dc4d98-c589-4ee0-be5f-706ee0a65be6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:56.176347 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a1dc4d98-c589-4ee0-be5f-706ee0a65be6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:56.177097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a1dc4d98-c589-4ee0-be5f-706ee0a65be6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:56.177523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a1dc4d98-c589-4ee0-be5f-706ee0a65be6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:56.202211 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a1dc4d98-c589-4ee0-be5f-706ee0a65be6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:12:56.204135 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fe7862be-f27b-4fcd-b212-e5493a6f23ef tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:56.204888 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fe7862be-f27b-4fcd-b212-e5493a6f23ef tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:56.211499 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fe7862be-f27b-4fcd-b212-e5493a6f23ef tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:56.211979 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fe7862be-f27b-4fcd-b212-e5493a6f23ef tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:56.212777 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fe7862be-f27b-4fcd-b212-e5493a6f23ef tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:56.213210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fe7862be-f27b-4fcd-b212-e5493a6f23ef tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:56.282792 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a1dc4d98-c589-4ee0-be5f-706ee0a65be6 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 204 len: 0 microversion: 2.1 time: 0.117551 May 25 16:12:56.283591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 318/627] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:12:56 2022] DELETE /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:12:56.292100 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6d579e21-0394-4646-86c6-140fb990f0f9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:56.292760 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6d579e21-0394-4646-86c6-140fb990f0f9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:56.299281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d579e21-0394-4646-86c6-140fb990f0f9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:56.299724 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d579e21-0394-4646-86c6-140fb990f0f9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:56.300564 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d579e21-0394-4646-86c6-140fb990f0f9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:56.301018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d579e21-0394-4646-86c6-140fb990f0f9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:56.437545 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6d579e21-0394-4646-86c6-140fb990f0f9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:56.445993 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6d579e21-0394-4646-86c6-140fb990f0f9 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1509 microversion: 2.1 time: 0.157999 May 25 16:12:56.446545 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 319/628] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:56 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:12:56.615086 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fe7862be-f27b-4fcd-b212-e5493a6f23ef tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:56.622702 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fe7862be-f27b-4fcd-b212-e5493a6f23ef tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1674 microversion: 2.1 time: 0.422450 May 25 16:12:56.623247 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 310/629] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:56 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1674 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:57.467400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-dd321cfb-1490-499b-80fa-c785a310bce2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:57.468484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-dd321cfb-1490-499b-80fa-c785a310bce2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:57.476621 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dd321cfb-1490-499b-80fa-c785a310bce2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:57.477071 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dd321cfb-1490-499b-80fa-c785a310bce2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:57.477841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dd321cfb-1490-499b-80fa-c785a310bce2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:57.478275 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dd321cfb-1490-499b-80fa-c785a310bce2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:57.619400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-dd321cfb-1490-499b-80fa-c785a310bce2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:57.627593 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-dd321cfb-1490-499b-80fa-c785a310bce2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1509 microversion: 2.1 time: 0.166704 May 25 16:12:57.628176 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 320/630] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:57 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:57.640499 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-aed2a30c-35bc-47a6-b6f1-da456a516428 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:57.641111 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-aed2a30c-35bc-47a6-b6f1-da456a516428 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:57.647949 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-aed2a30c-35bc-47a6-b6f1-da456a516428 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:57.648401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-aed2a30c-35bc-47a6-b6f1-da456a516428 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:57.649162 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-aed2a30c-35bc-47a6-b6f1-da456a516428 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:57.649596 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-aed2a30c-35bc-47a6-b6f1-da456a516428 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:57.781062 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-aed2a30c-35bc-47a6-b6f1-da456a516428 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:57.788660 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-aed2a30c-35bc-47a6-b6f1-da456a516428 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1674 microversion: 2.1 time: 0.152381 May 25 16:12:57.789229 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 311/631] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:57 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:58.649428 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-459c49f9-b23f-4551-94aa-6b0969c1f557 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:58.650429 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-459c49f9-b23f-4551-94aa-6b0969c1f557 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:58.661365 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-459c49f9-b23f-4551-94aa-6b0969c1f557 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:58.662120 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-459c49f9-b23f-4551-94aa-6b0969c1f557 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:58.663364 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-459c49f9-b23f-4551-94aa-6b0969c1f557 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:58.664133 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-459c49f9-b23f-4551-94aa-6b0969c1f557 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:58.806084 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ed7ce0db-f274-4187-b318-c7b4396711a8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:58.806692 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ed7ce0db-f274-4187-b318-c7b4396711a8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:58.807679 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-459c49f9-b23f-4551-94aa-6b0969c1f557 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:58.813861 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0db-f274-4187-b318-c7b4396711a8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:58.814301 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0db-f274-4187-b318-c7b4396711a8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:58.815057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0db-f274-4187-b318-c7b4396711a8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:58.815484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0db-f274-4187-b318-c7b4396711a8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:58.815658 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-459c49f9-b23f-4551-94aa-6b0969c1f557 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1509 microversion: 2.1 time: 0.172529 May 25 16:12:58.816309 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 321/632] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:58 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:58.949579 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ed7ce0db-f274-4187-b318-c7b4396711a8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:12:58.958858 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ed7ce0db-f274-4187-b318-c7b4396711a8 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1674 microversion: 2.1 time: 0.156458 May 25 16:12:58.959655 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 312/633] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:58 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:12:59.832744 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-187b3664-aad2-4df0-97b3-a291736b6794 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:59.833548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-187b3664-aad2-4df0-97b3-a291736b6794 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:59.840641 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-187b3664-aad2-4df0-97b3-a291736b6794 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:59.841509 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-187b3664-aad2-4df0-97b3-a291736b6794 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:59.842276 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-187b3664-aad2-4df0-97b3-a291736b6794 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:59.843541 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-187b3664-aad2-4df0-97b3-a291736b6794 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:59.861872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-50906dca-d4ea-42e5-84e4-88f42f095eeb req-17a9beed-5973-4770-8749-c1f65debbc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b973684d-dabc-4073-9bd7-cfff6639d737", "name": "network-vif-deleted", "tag": "8da9abd8-394d-4fcf-b31f-86f41ec75434"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:12:59.876874 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-50906dca-d4ea-42e5-84e4-88f42f095eeb req-17a9beed-5973-4770-8749-c1f65debbc0c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:59.877312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-50906dca-d4ea-42e5-84e4-88f42f095eeb req-17a9beed-5973-4770-8749-c1f65debbc0c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:59.900608 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-50906dca-d4ea-42e5-84e4-88f42f095eeb req-17a9beed-5973-4770-8749-c1f65debbc0c service nova] Creating event network-vif-deleted:8da9abd8-394d-4fcf-b31f-86f41ec75434 for instance b973684d-dabc-4073-9bd7-cfff6639d737 on hv-cinder-84327 May 25 16:12:59.911458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-50906dca-d4ea-42e5-84e4-88f42f095eeb req-17a9beed-5973-4770-8749-c1f65debbc0c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054671 May 25 16:12:59.912726 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 313/634] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:12:59.981502 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-12b2ec64-d0f6-4199-ae61-e98738fbbb0b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:12:59.982488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-12b2ec64-d0f6-4199-ae61-e98738fbbb0b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:12:59.989296 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-12b2ec64-d0f6-4199-ae61-e98738fbbb0b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:59.990126 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-12b2ec64-d0f6-4199-ae61-e98738fbbb0b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:12:59.990921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-12b2ec64-d0f6-4199-ae61-e98738fbbb0b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:12:59.991525 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-12b2ec64-d0f6-4199-ae61-e98738fbbb0b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:00.065551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-187b3664-aad2-4df0-97b3-a291736b6794 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:00.073466 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-187b3664-aad2-4df0-97b3-a291736b6794 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 200 len: 1467 microversion: 2.1 time: 0.244600 May 25 16:13:00.074597 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 322/635] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:59 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 1467 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:00.084619 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-12b2ec64-d0f6-4199-ae61-e98738fbbb0b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:00.092358 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-12b2ec64-d0f6-4199-ae61-e98738fbbb0b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 200 len: 1607 microversion: 2.1 time: 0.115405 May 25 16:13:00.092931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 314/636] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:12:59 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 1607 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:13:01.090825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:01.091619 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: b973684d-dabc-4073-9bd7-cfff6639d737] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:01.098879 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.099338 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.100849 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.101276 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.109749 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:01.110331 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:01.116578 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] HTTP exception thrown: Instance b973684d-dabc-4073-9bd7-cfff6639d737 could not be found. May 25 16:13:01.117635 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.118074 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Request method failure captured: May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 HTTP/1.1 May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRflM6mHDm1IBYk5QaFi8bNjnvFMogN6K5xhr0eF8qcFq4HnvnAwua1TzxRwkhZrxQgnNUGLSd59qg-4sCGheYS3-r_aF3j2JLouc0h15X9XI1GCCUOHxQjrZ03NCFul-f6dXb6yj03zJ8KDl-0VtoQLd6EKr99XEa8_V75b8Gqj1M May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:13:01.118212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7733d8b5059433eb18dc6b174eb9533", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: d0427d9cce40423185a40df61c3617a6 May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance b973684d-dabc-4073-9bd7-cfff6639d737 could not be found. May 25 16:13:01.119735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'b973684d-dabc-4073-9bd7-cfff6639d737'} May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b973684d-dabc-4073-9bd7-cfff6639d737 could not be found. May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:01.120639 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b973684d-dabc-4073-9bd7-cfff6639d737 could not be found. May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b973684d-dabc-4073-9bd7-cfff6639d737 could not be found. May 25 16:13:01.122142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:01.123762 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Returning 404 to user: Instance b973684d-dabc-4073-9bd7-cfff6639d737 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:01.123762 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-87317f3a-3341-4d47-9b40-6687e62126a2 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737" status: 404 len: 111 microversion: 2.1 time: 0.032894 May 25 16:13:01.123762 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 323/637] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:01 2022] GET /compute/v2.1/servers/b973684d-dabc-4073-9bd7-cfff6639d737 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:13:01.125100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.125540 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.128717 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1e011053-1e9c-43f7-a696-05ad4c97dddd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:01.129804 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1e011053-1e9c-43f7-a696-05ad4c97dddd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:01.136209 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1e011053-1e9c-43f7-a696-05ad4c97dddd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.136990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1e011053-1e9c-43f7-a696-05ad4c97dddd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.137773 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1e011053-1e9c-43f7-a696-05ad4c97dddd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.138212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1e011053-1e9c-43f7-a696-05ad4c97dddd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.142163 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] HTTP exception thrown: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Request method failure captured: May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 HTTP/1.1 May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRofSYuvVcCS4JFWumS-5BTEj9IoXM6iRbeKNhZFXxA-ufcTsUWjU4Cu1OtPIe7cK_Azge968DUIIOsuBJD25sXuBG81wYHdKRY1YqE3wnxOr48KWgpt9l8EujzZf1P7sl1irT8GNN9KA86JTgkAggMSgJg9Zh3sMkrhOffnxUjIqM May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 93946fd1575e45428d2388015d64628f May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:13:01.143862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93946fd1575e45428d2388015d64628f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93946fd1575e45428d2388015d64628f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeTestJSON-508094849 May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 93946fd1575e45428d2388015d64628f May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeTestJSON-508094849-project May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: a0289402c6f245839a86b7b66714a8f6 May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeTestJSON-508094849-project May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:13:01.145180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '6c5f2914-854d-4d77-82e5-680200d4d6c8'} May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:01.145921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:13:01.147161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:01.148256 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Returning 404 to user: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:01.148256 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9108a196-5594-4951-a7b8-a23a731b66e2 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 404 len: 111 microversion: 2.1 time: 0.039437 May 25 16:13:01.148256 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 315/638] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:01 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:13:01.154472 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1bc4a53a-10f4-488d-b7c7-7c8cff35e641 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '.version_select at 0x7fbae3e9e280>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:01.174153 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1e011053-1e9c-43f7-a696-05ad4c97dddd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:13:01.174587 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1bc4a53a-10f4-488d-b7c7-7c8cff35e641 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010957746" status: 202 len: 0 microversion: 2.1 time: 0.023840 May 25 16:13:01.175864 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 316/639] 10.222.0.85 () {58 vars in 1220 bytes} [Wed May 25 16:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010957746 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:13:01.204958 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:01.266379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b62d702b-d081-438d-9543-dbba36c5e660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:01.268031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b62d702b-d081-438d-9543-dbba36c5e660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:01.273963 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1e011053-1e9c-43f7-a696-05ad4c97dddd tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 204 len: 0 microversion: 2.1 time: 0.149114 May 25 16:13:01.276141 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b62d702b-d081-438d-9543-dbba36c5e660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.276558 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 324/640] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:13:01 2022] DELETE /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:13:01.280391 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b62d702b-d081-438d-9543-dbba36c5e660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.281820 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b62d702b-d081-438d-9543-dbba36c5e660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.282667 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b62d702b-d081-438d-9543-dbba36c5e660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.296359 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-fae52be6-e92b-4dd5-b9db-c423440f7a12 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:01.297586 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-fae52be6-e92b-4dd5-b9db-c423440f7a12 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:01.305056 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fae52be6-e92b-4dd5-b9db-c423440f7a12 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.306416 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fae52be6-e92b-4dd5-b9db-c423440f7a12 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.307202 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fae52be6-e92b-4dd5-b9db-c423440f7a12 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.307790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fae52be6-e92b-4dd5-b9db-c423440f7a12 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.311499 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b62d702b-d081-438d-9543-dbba36c5e660 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/ips" status: 200 len: 150 microversion: 2.1 time: 0.050199 May 25 16:13:01.318108 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 317/641] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:13:01 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:01.457009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-fae52be6-e92b-4dd5-b9db-c423440f7a12 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:01.464686 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-fae52be6-e92b-4dd5-b9db-c423440f7a12 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.183017 May 25 16:13:01.465569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 325/642] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:01 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:01.913126 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-059942db-ad12-47f4-a19f-ed452d2ae6b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'create', calling method: .version_select at 0x7fbae3e9e1f0>, body: {"keypair": {"name": "tempest-keypair-1241319946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxqjG9C6GTobRvm1Tfxv/PMVGpJ84r7dOa6chqobRm8Z7cB0yBYid8KN31bIFZNYwzbe36+JMpSvYzgDb6I7wBbJyO95xRXakIYvm4Fw0IZ8HO8gYW8sdTwYHE+A5am+g=="}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:01.927721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-059942db-ad12-47f4-a19f-ed452d2ae6b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Getting quotas for project 93946fd1575e45428d2388015d64628f. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:13:01.928295 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-ce958d14-73a5-4ead-b166-0593900689c7 req-165ee3c5-15d1-47ef-a889-ad2dd4ebd4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c5f2914-854d-4d77-82e5-680200d4d6c8", "name": "network-vif-deleted", "tag": "ba260aab-9e99-4e6c-ad1d-fdc814dca2d5"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:01.931711 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-059942db-ad12-47f4-a19f-ed452d2ae6b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Getting quotas for user a0289402c6f245839a86b7b66714a8f6 and project 93946fd1575e45428d2388015d64628f. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:13:01.936808 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-ce958d14-73a5-4ead-b166-0593900689c7 req-165ee3c5-15d1-47ef-a889-ad2dd4ebd4db service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:01.937236 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-ce958d14-73a5-4ead-b166-0593900689c7 req-165ee3c5-15d1-47ef-a889-ad2dd4ebd4db service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:01.949045 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-ce958d14-73a5-4ead-b166-0593900689c7 req-165ee3c5-15d1-47ef-a889-ad2dd4ebd4db service nova] Creating event network-vif-deleted:ba260aab-9e99-4e6c-ad1d-fdc814dca2d5 for instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 on hv-cinder-84327 May 25 16:13:01.954200 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-ce958d14-73a5-4ead-b166-0593900689c7 req-165ee3c5-15d1-47ef-a889-ad2dd4ebd4db service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029585 May 25 16:13:01.955216 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 326/643] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:13:01.955859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-059942db-ad12-47f4-a19f-ed452d2ae6b6 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046554 May 25 16:13:01.956476 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 318/644] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:13:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:02.482778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4c426af9-4c14-4a0f-9fe2-80b0351bb92d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:02.483555 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4c426af9-4c14-4a0f-9fe2-80b0351bb92d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:02.490725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4c426af9-4c14-4a0f-9fe2-80b0351bb92d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:02.491267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4c426af9-4c14-4a0f-9fe2-80b0351bb92d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:02.492064 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4c426af9-4c14-4a0f-9fe2-80b0351bb92d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:02.492514 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4c426af9-4c14-4a0f-9fe2-80b0351bb92d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:02.688193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-eaa51295-3c1b-4083-9226-89f6ab25f1df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8e4832d-7c66-4047-be2a-4064e894f64b"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:02.690071 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-eaa51295-3c1b-4083-9226-89f6ab25f1df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:02.696766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-eaa51295-3c1b-4083-9226-89f6ab25f1df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:02.697313 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-eaa51295-3c1b-4083-9226-89f6ab25f1df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:02.698168 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-eaa51295-3c1b-4083-9226-89f6ab25f1df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:02.698698 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-eaa51295-3c1b-4083-9226-89f6ab25f1df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:02.940982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4c426af9-4c14-4a0f-9fe2-80b0351bb92d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:02.948684 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4c426af9-4c14-4a0f-9fe2-80b0351bb92d tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.470213 May 25 16:13:02.949252 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 327/645] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:02 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:03.605384 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-572295766", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11c18221-40ed-46b2-9546-1ebebf8fc518"}], "security_groups": [{"name": "tempest-securitygroup--1292397895"}], "key_name": "tempest-keypair-1241319946", "user_data": "}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:03.708399 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.network.neutron [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] validate_networks() for [('11c18221-40ed-46b2-9546-1ebebf8fc518', None, None, None, None, None)] {{(pid=117764) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:13:04.119882 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Flavor limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:13:04.120427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Image limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:13:04.121161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Flavor pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:13:04.121793 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Image pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:13:04.122303 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:13:04.133303 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:04.133746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:04.134534 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:04.134967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:04.152395 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Getting quotas for project 93946fd1575e45428d2388015d64628f. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:13:04.156969 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Getting quotas for user a0289402c6f245839a86b7b66714a8f6 and project 93946fd1575e45428d2388015d64628f. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:13:04.172936 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Going to run 1 instances... {{(pid=117764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:13:04.176609 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:13:04.227088 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-51c8ebc3-bdc3-4b3c-b0a8-ff6be1c88ad4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.625986 May 25 16:13:04.227845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 328/646] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:13:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 16:13:04.232429 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-079623ca-0568-4f3e-8f8e-abdebe6f5b60 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:04.233037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-079623ca-0568-4f3e-8f8e-abdebe6f5b60 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:04.240036 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-079623ca-0568-4f3e-8f8e-abdebe6f5b60 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:04.240487 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-079623ca-0568-4f3e-8f8e-abdebe6f5b60 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:04.241263 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-079623ca-0568-4f3e-8f8e-abdebe6f5b60 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:04.241698 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-079623ca-0568-4f3e-8f8e-abdebe6f5b60 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:04.377069 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-079623ca-0568-4f3e-8f8e-abdebe6f5b60 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:04.385719 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-079623ca-0568-4f3e-8f8e-abdebe6f5b60 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1523 microversion: 2.1 time: 0.156882 May 25 16:13:04.386292 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 329/647] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:04 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:04.391388 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6cd8b562-4413-4f38-9e4e-3ad55201359c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:04.392016 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6cd8b562-4413-4f38-9e4e-3ad55201359c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:04.445778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6cd8b562-4413-4f38-9e4e-3ad55201359c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:04.452596 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6cd8b562-4413-4f38-9e4e-3ad55201359c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1237 microversion: 2.1 time: 0.065060 May 25 16:13:04.453156 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 330/648] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:04 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:04.650150 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:04.672764 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-eaa51295-3c1b-4083-9226-89f6ab25f1df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.989057 May 25 16:13:04.673457 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 319/649] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:13:02 2022] POST /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments => generated 194 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:04.856504 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:13:04.856692 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Wed May 25 16:13:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:13:05.316028 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-6dabceac-edb0-4b91-b675-d425226c8935 req-0a08d813-6691-4900-b13f-90ba8bd01c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f650730-0534-4f4b-92b9-6d6be8cc54c7", "name": "network-vif-deleted", "tag": "5e831b32-3912-4fc5-8b80-9b3a1edda724"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:05.325884 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-6dabceac-edb0-4b91-b675-d425226c8935 req-0a08d813-6691-4900-b13f-90ba8bd01c7a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:05.326691 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-6dabceac-edb0-4b91-b675-d425226c8935 req-0a08d813-6691-4900-b13f-90ba8bd01c7a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:05.339313 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-6dabceac-edb0-4b91-b675-d425226c8935 req-0a08d813-6691-4900-b13f-90ba8bd01c7a service nova] Creating event network-vif-deleted:5e831b32-3912-4fc5-8b80-9b3a1edda724 for instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 on hv-cinder-84327 May 25 16:13:05.344924 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-6dabceac-edb0-4b91-b675-d425226c8935 req-0a08d813-6691-4900-b13f-90ba8bd01c7a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 May 25 16:13:05.345524 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 331/650] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:05.404122 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:05.405039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:05.414511 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:05.415493 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:05.416384 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:05.416836 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:05.456057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:05.457086 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:05.457886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lazy-loading 'fault' on Instance uuid 8f650730-0534-4f4b-92b9-6d6be8cc54c7 {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:13:05.471553 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e437f7ef-acff-4d38-9a7e-01a38db35758 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:05.472790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e437f7ef-acff-4d38-9a7e-01a38db35758 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:05.484802 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e437f7ef-acff-4d38-9a7e-01a38db35758 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:05.486944 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e437f7ef-acff-4d38-9a7e-01a38db35758 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:05.488549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e437f7ef-acff-4d38-9a7e-01a38db35758 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:05.489138 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e437f7ef-acff-4d38-9a7e-01a38db35758 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:05.510108 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0427d9cce40423185a40df61c3617a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7733d8b5059433eb18dc6b174eb9533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:05.518704 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-75016ad4-7983-40f1-95fb-fa2358256b06 tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 200 len: 1312 microversion: 2.1 time: 0.119753 May 25 16:13:05.519278 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 320/651] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:05 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:05.558728 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e437f7ef-acff-4d38-9a7e-01a38db35758 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:05.566118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e437f7ef-acff-4d38-9a7e-01a38db35758 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1295 microversion: 2.1 time: 0.099113 May 25 16:13:05.566678 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 332/652] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:05 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:13:06.535608 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:06.536276 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] [instance: 8f650730-0534-4f4b-92b9-6d6be8cc54c7] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:06.543216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:06.543664 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:06.544465 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:06.545093 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:06.558883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] HTTP exception thrown: Instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 could not be found. May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Request method failure captured: May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 HTTP/1.1 May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRflM6mHDm1IBYk5QaFi8bNjnvFMogN6K5xhr0eF8qcFq4HnvnAwua1TzxRwkhZrxQgnNUGLSd59qg-4sCGheYS3-r_aF3j2JLouc0h15X9XI1GCCUOHxQjrZ03NCFul-f6dXb6yj03zJ8KDl-0VtoQLd6EKr99XEa8_V75b8Gqj1M May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:13:06.560576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f7733d8b5059433eb18dc6b174eb9533", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f7733d8b5059433eb18dc6b174eb9533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: f7733d8b5059433eb18dc6b174eb9533 May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247250960 May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: d0427d9cce40423185a40df61c3617a6 May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247250960-project May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 could not be found. May 25 16:13:06.561986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '8f650730-0534-4f4b-92b9-6d6be8cc54c7'} May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 could not be found. May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:06.562751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 could not be found. May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 could not be found. May 25 16:13:06.564288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:06.565319 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] Returning 404 to user: Instance 8f650730-0534-4f4b-92b9-6d6be8cc54c7 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:06.565319 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1ef5ba92-a5c0-4d02-9e65-f2029e9bf1af tempest-ServerRescueNegativeTestJSON-247250960 tempest-ServerRescueNegativeTestJSON-247250960-project] 10.222.0.85 "GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7" status: 404 len: 111 microversion: 2.1 time: 0.030346 May 25 16:13:06.565873 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 321/653] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:06 2022] GET /compute/v2.1/servers/8f650730-0534-4f4b-92b9-6d6be8cc54c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:13:06.583438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f9513b75-57d7-4526-954b-39546df018c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:06.584114 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f9513b75-57d7-4526-954b-39546df018c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:06.590819 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9513b75-57d7-4526-954b-39546df018c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:06.591240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9513b75-57d7-4526-954b-39546df018c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:06.592519 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9513b75-57d7-4526-954b-39546df018c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:06.593202 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9513b75-57d7-4526-954b-39546df018c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:06.787309 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f9513b75-57d7-4526-954b-39546df018c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:06.795272 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f9513b75-57d7-4526-954b-39546df018c4 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1363 microversion: 2.1 time: 0.216683 May 25 16:13:06.796035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 333/654] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:06 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:07.363598 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-29e0d743-571e-4a8e-8e7d-ccc3938ee02f req-8a9cae85-dd2e-4407-8b0e-050a9bd61836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d82389-e0ca-4a82-98ae-47c6eac2a000", "tag": "1ba0185d-8af8-486d-89b0-0ed2b1f893a5"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:07.372474 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-29e0d743-571e-4a8e-8e7d-ccc3938ee02f req-8a9cae85-dd2e-4407-8b0e-050a9bd61836 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:07.373360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-29e0d743-571e-4a8e-8e7d-ccc3938ee02f req-8a9cae85-dd2e-4407-8b0e-050a9bd61836 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:07.384647 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-29e0d743-571e-4a8e-8e7d-ccc3938ee02f req-8a9cae85-dd2e-4407-8b0e-050a9bd61836 service nova] Creating event network-changed:1ba0185d-8af8-486d-89b0-0ed2b1f893a5 for instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 on hv-cinder-84327 May 25 16:13:07.389717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-29e0d743-571e-4a8e-8e7d-ccc3938ee02f req-8a9cae85-dd2e-4407-8b0e-050a9bd61836 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030778 May 25 16:13:07.390560 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 322/655] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:07.812324 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-015d3723-a2e8-43dc-bf11-bb2c1b7a49e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:07.812937 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-015d3723-a2e8-43dc-bf11-bb2c1b7a49e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:07.819855 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-015d3723-a2e8-43dc-bf11-bb2c1b7a49e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:07.820527 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-015d3723-a2e8-43dc-bf11-bb2c1b7a49e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:07.822240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-015d3723-a2e8-43dc-bf11-bb2c1b7a49e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:07.822889 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-015d3723-a2e8-43dc-bf11-bb2c1b7a49e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:07.958476 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-015d3723-a2e8-43dc-bf11-bb2c1b7a49e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:07.966910 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-015d3723-a2e8-43dc-bf11-bb2c1b7a49e5 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1363 microversion: 2.1 time: 0.158597 May 25 16:13:07.967744 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 334/656] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:07 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:09.050262 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-170784f7-97d1-4be8-b800-9015193e92c1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:09.051451 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-170784f7-97d1-4be8-b800-9015193e92c1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:09.058531 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-170784f7-97d1-4be8-b800-9015193e92c1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:09.059076 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-170784f7-97d1-4be8-b800-9015193e92c1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:09.059986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-170784f7-97d1-4be8-b800-9015193e92c1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:09.060504 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-170784f7-97d1-4be8-b800-9015193e92c1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:09.291425 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-170784f7-97d1-4be8-b800-9015193e92c1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:09.299436 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-170784f7-97d1-4be8-b800-9015193e92c1 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1363 microversion: 2.1 time: 0.319280 May 25 16:13:09.300406 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 323/657] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:08 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:10.317084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-13620e75-081b-49d5-aa42-fe331948e72e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:10.317698 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-13620e75-081b-49d5-aa42-fe331948e72e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:10.324512 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-13620e75-081b-49d5-aa42-fe331948e72e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:10.324992 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-13620e75-081b-49d5-aa42-fe331948e72e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:10.325766 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-13620e75-081b-49d5-aa42-fe331948e72e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:10.326209 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-13620e75-081b-49d5-aa42-fe331948e72e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:10.481484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-13620e75-081b-49d5-aa42-fe331948e72e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:10.490530 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-13620e75-081b-49d5-aa42-fe331948e72e tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1363 microversion: 2.1 time: 0.177014 May 25 16:13:10.491626 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 335/658] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:10 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:11.360999 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8e4832d-7c66-4047-be2a-4064e894f64b"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:11.362125 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:11.369083 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:11.369529 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:11.370295 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:11.371355 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:11.467947 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Invalid volume: volume a8e4832d-7c66-4047-be2a-4064e894f64b is already attached to instances: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: POST /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments HTTP/1.1 May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 74 May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:13:11.469853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {"volumeAttachment": {"volumeId": "a8e4832d-7c66-4047-be2a-4064e894f64b"}} May 25 16:13:11.471435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Invalid volume: volume a8e4832d-7c66-4047-be2a-4064e894f64b is already attached to instances: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'server_id': '45665f8b-ba12-41a5-8ba1-43b9dcd8e166', 'body': {'volumeAttachment': {'volumeId': 'a8e4832d-7c66-4047-be2a-4064e894f64b'}}} May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a8e4832d-7c66-4047-be2a-4064e894f64b is already attached to instances: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:11.472492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a8e4832d-7c66-4047-be2a-4064e894f64b is already attached to instances: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:11.474176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:11.475565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:11.475565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:11.475565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:11.475565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a8e4832d-7c66-4047-be2a-4064e894f64b is already attached to instances: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 May 25 16:13:11.475565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:13:11.475565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 400 to user: Invalid volume: volume a8e4832d-7c66-4047-be2a-4064e894f64b is already attached to instances: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:11.475565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8244f9ab-8295-4eab-ac28-eb0ef453e3bf tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114776 May 25 16:13:11.475565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 324/659] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:13:11 2022] POST /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 25 16:13:11.509295 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-836a46ef-b939-4952-9f62-15119984ac02 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:11.511201 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-836a46ef-b939-4952-9f62-15119984ac02 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:11.527519 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-836a46ef-b939-4952-9f62-15119984ac02 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:11.528144 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-836a46ef-b939-4952-9f62-15119984ac02 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:11.528927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-836a46ef-b939-4952-9f62-15119984ac02 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:11.529363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-836a46ef-b939-4952-9f62-15119984ac02 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:11.541732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-720114e1-e0d1-4f3c-8e84-c984f3074647 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:11.542204 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-720114e1-e0d1-4f3c-8e84-c984f3074647 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:11.548480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-720114e1-e0d1-4f3c-8e84-c984f3074647 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:11.548878 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-720114e1-e0d1-4f3c-8e84-c984f3074647 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:11.549638 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-720114e1-e0d1-4f3c-8e84-c984f3074647 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:11.550063 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-720114e1-e0d1-4f3c-8e84-c984f3074647 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:11.639878 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-720114e1-e0d1-4f3c-8e84-c984f3074647 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lazy-loading 'services' on Instance uuid 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:13:11.679649 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-836a46ef-b939-4952-9f62-15119984ac02 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:11.689321 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-836a46ef-b939-4952-9f62-15119984ac02 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1363 microversion: 2.1 time: 0.185521 May 25 16:13:11.689900 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 336/660] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:11 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:11.721330 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-720114e1-e0d1-4f3c-8e84-c984f3074647 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments/a8e4832d-7c66-4047-be2a-4064e894f64b" status: 202 len: 0 microversion: 2.1 time: 0.183463 May 25 16:13:11.721919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 325/661] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:13:11 2022] DELETE /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments/a8e4832d-7c66-4047-be2a-4064e894f64b => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:13:11.736086 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3b6ca3d0-c94b-4d8e-b6f3-02e5a4e6b5a6 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:11.737018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3b6ca3d0-c94b-4d8e-b6f3-02e5a4e6b5a6 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:11.752244 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3b6ca3d0-c94b-4d8e-b6f3-02e5a4e6b5a6 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:11.752901 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3b6ca3d0-c94b-4d8e-b6f3-02e5a4e6b5a6 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:11.753842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3b6ca3d0-c94b-4d8e-b6f3-02e5a4e6b5a6 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:11.754580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3b6ca3d0-c94b-4d8e-b6f3-02e5a4e6b5a6 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:11.790743 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3b6ca3d0-c94b-4d8e-b6f3-02e5a4e6b5a6 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059584 May 25 16:13:11.791603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 337/662] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:13:11 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:12.702935 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=4 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:12.708258 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8a35f9a4-e31e-479e-984f-96488bec3b5d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:12.709069 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8a35f9a4-e31e-479e-984f-96488bec3b5d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:12.716523 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8a35f9a4-e31e-479e-984f-96488bec3b5d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:12.717057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8a35f9a4-e31e-479e-984f-96488bec3b5d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:12.718014 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8a35f9a4-e31e-479e-984f-96488bec3b5d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:12.718448 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8a35f9a4-e31e-479e-984f-96488bec3b5d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:12.802839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3a60d33e-802a-4351-8190-0d7d924c1136 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:12.804433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3a60d33e-802a-4351-8190-0d7d924c1136 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:12.811441 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a60d33e-802a-4351-8190-0d7d924c1136 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:12.812024 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a60d33e-802a-4351-8190-0d7d924c1136 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:12.812849 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a60d33e-802a-4351-8190-0d7d924c1136 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:12.813502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3a60d33e-802a-4351-8190-0d7d924c1136 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:12.843225 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3a60d33e-802a-4351-8190-0d7d924c1136 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044531 May 25 16:13:12.843800 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 338/663] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:13:12 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 16:13:12.867181 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-8a35f9a4-e31e-479e-984f-96488bec3b5d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:12.875184 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8a35f9a4-e31e-479e-984f-96488bec3b5d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1363 microversion: 2.1 time: 0.173140 May 25 16:13:12.875877 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 326/664] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:12 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:12.904539 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8ca9c8a3-73a5-4608-b26d-b01ee352e206 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:12.905037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8ca9c8a3-73a5-4608-b26d-b01ee352e206 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:12.910970 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ca9c8a3-73a5-4608-b26d-b01ee352e206 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:12.911410 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ca9c8a3-73a5-4608-b26d-b01ee352e206 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:12.912187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ca9c8a3-73a5-4608-b26d-b01ee352e206 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:12.912619 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ca9c8a3-73a5-4608-b26d-b01ee352e206 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:12.942429 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8ca9c8a3-73a5-4608-b26d-b01ee352e206 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:13:13.028406 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8ca9c8a3-73a5-4608-b26d-b01ee352e206 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 204 len: 0 microversion: 2.1 time: 0.127525 May 25 16:13:13.029275 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 339/665] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:13:12 2022] DELETE /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:13:13.045179 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2cfaf35a-4475-4c9d-956d-0f8f57387bd8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:13.045737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2cfaf35a-4475-4c9d-956d-0f8f57387bd8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:13.052254 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2cfaf35a-4475-4c9d-956d-0f8f57387bd8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:13.052705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2cfaf35a-4475-4c9d-956d-0f8f57387bd8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:13.053512 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2cfaf35a-4475-4c9d-956d-0f8f57387bd8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:13.053973 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2cfaf35a-4475-4c9d-956d-0f8f57387bd8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:13.261773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2cfaf35a-4475-4c9d-956d-0f8f57387bd8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:13.270291 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2cfaf35a-4475-4c9d-956d-0f8f57387bd8 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1682 microversion: 2.1 time: 0.229239 May 25 16:13:13.270878 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 327/666] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:13 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:13:13.295350 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-51969b15-a0a3-4ee8-b9cb-cf6d1ba6ed82 req-574168be-1c7a-4406-b87b-e781affd0072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d82389-e0ca-4a82-98ae-47c6eac2a000", "name": "network-vif-plugged", "status": "completed", "tag": "1ba0185d-8af8-486d-89b0-0ed2b1f893a5"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:13.311866 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-51969b15-a0a3-4ee8-b9cb-cf6d1ba6ed82 req-574168be-1c7a-4406-b87b-e781affd0072 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:13.312850 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-51969b15-a0a3-4ee8-b9cb-cf6d1ba6ed82 req-574168be-1c7a-4406-b87b-e781affd0072 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:13.324684 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-51969b15-a0a3-4ee8-b9cb-cf6d1ba6ed82 req-574168be-1c7a-4406-b87b-e781affd0072 service nova] Creating event network-vif-plugged:1ba0185d-8af8-486d-89b0-0ed2b1f893a5 for instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 on hv-cinder-84327 May 25 16:13:13.329589 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-51969b15-a0a3-4ee8-b9cb-cf6d1ba6ed82 req-574168be-1c7a-4406-b87b-e781affd0072 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039146 May 25 16:13:13.330569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 340/667] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:13.892172 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-29f4a653-9f94-4c91-8609-6a20d9faac0c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:13.892779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-29f4a653-9f94-4c91-8609-6a20d9faac0c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:13.899255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29f4a653-9f94-4c91-8609-6a20d9faac0c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:13.899673 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29f4a653-9f94-4c91-8609-6a20d9faac0c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:13.900649 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29f4a653-9f94-4c91-8609-6a20d9faac0c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:13.901079 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29f4a653-9f94-4c91-8609-6a20d9faac0c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:14.032221 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-29f4a653-9f94-4c91-8609-6a20d9faac0c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:14.040311 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-29f4a653-9f94-4c91-8609-6a20d9faac0c tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1363 microversion: 2.1 time: 0.151987 May 25 16:13:14.040938 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 328/668] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:13 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:14.285529 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:14.289840 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f210a0d6-ac42-4190-807c-f18c9f27c49b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:14.290559 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f210a0d6-ac42-4190-807c-f18c9f27c49b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:14.293703 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:14.298233 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f210a0d6-ac42-4190-807c-f18c9f27c49b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:14.298702 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f210a0d6-ac42-4190-807c-f18c9f27c49b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:14.299467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f210a0d6-ac42-4190-807c-f18c9f27c49b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:14.300087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f210a0d6-ac42-4190-807c-f18c9f27c49b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:14.439787 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f210a0d6-ac42-4190-807c-f18c9f27c49b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:14.448097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f210a0d6-ac42-4190-807c-f18c9f27c49b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1682 microversion: 2.1 time: 0.163970 May 25 16:13:14.448861 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 341/669] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:14 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:15.058959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-562fd18d-79a9-4e17-aa97-d1290f7f3be9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:15.059839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-562fd18d-79a9-4e17-aa97-d1290f7f3be9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:15.067476 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-562fd18d-79a9-4e17-aa97-d1290f7f3be9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:15.068405 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-562fd18d-79a9-4e17-aa97-d1290f7f3be9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:15.069468 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-562fd18d-79a9-4e17-aa97-d1290f7f3be9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:15.069903 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-562fd18d-79a9-4e17-aa97-d1290f7f3be9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:15.210425 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-562fd18d-79a9-4e17-aa97-d1290f7f3be9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:15.219472 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-562fd18d-79a9-4e17-aa97-d1290f7f3be9 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1363 microversion: 2.1 time: 0.165526 May 25 16:13:15.220090 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 329/670] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:15 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:15.466660 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d98e4563-4198-453e-b6a0-17d69b2d7604 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:15.467201 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d98e4563-4198-453e-b6a0-17d69b2d7604 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:15.469159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=8 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:15.475611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d98e4563-4198-453e-b6a0-17d69b2d7604 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:15.476106 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d98e4563-4198-453e-b6a0-17d69b2d7604 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:15.476862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d98e4563-4198-453e-b6a0-17d69b2d7604 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:15.477289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d98e4563-4198-453e-b6a0-17d69b2d7604 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:15.496621 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:15.680563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d98e4563-4198-453e-b6a0-17d69b2d7604 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:15.689383 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d98e4563-4198-453e-b6a0-17d69b2d7604 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1682 microversion: 2.1 time: 0.226832 May 25 16:13:15.689963 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 342/671] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:15 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:16.021317 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-7dbb0605-30dc-48ee-9048-b4837b9e6e96 req-80f2e58a-1233-4f28-9db8-6ef60a9ad7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45665f8b-ba12-41a5-8ba1-43b9dcd8e166", "name": "network-vif-deleted", "tag": "94bc6516-bbb3-40bb-99c6-68f8fbe6c3a5"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:16.024978 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:16.032021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-7dbb0605-30dc-48ee-9048-b4837b9e6e96 req-80f2e58a-1233-4f28-9db8-6ef60a9ad7fd service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:16.032476 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-7dbb0605-30dc-48ee-9048-b4837b9e6e96 req-80f2e58a-1233-4f28-9db8-6ef60a9ad7fd service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:16.046603 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-7dbb0605-30dc-48ee-9048-b4837b9e6e96 req-80f2e58a-1233-4f28-9db8-6ef60a9ad7fd service nova] Creating event network-vif-deleted:94bc6516-bbb3-40bb-99c6-68f8fbe6c3a5 for instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 on hv-cinder-84327 May 25 16:13:16.051790 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-7dbb0605-30dc-48ee-9048-b4837b9e6e96 req-80f2e58a-1233-4f28-9db8-6ef60a9ad7fd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034283 May 25 16:13:16.052585 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 330/672] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:16.236724 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0e058752-2d3a-48b3-801c-6e39e0cdc84a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:16.237357 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0e058752-2d3a-48b3-801c-6e39e0cdc84a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:16.243781 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e058752-2d3a-48b3-801c-6e39e0cdc84a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:16.244260 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e058752-2d3a-48b3-801c-6e39e0cdc84a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:16.245026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e058752-2d3a-48b3-801c-6e39e0cdc84a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:16.245453 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0e058752-2d3a-48b3-801c-6e39e0cdc84a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:16.382862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0e058752-2d3a-48b3-801c-6e39e0cdc84a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:16.390785 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0e058752-2d3a-48b3-801c-6e39e0cdc84a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1363 microversion: 2.1 time: 0.158319 May 25 16:13:16.391493 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 343/673] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:16 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:16.710810 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:16.711522 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:16.718767 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:16.719247 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:16.720225 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:16.720883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:16.752146 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:16.752593 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:16.753027 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lazy-loading 'fault' on Instance uuid 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:13:16.801249 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:16.809811 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ce06b00c-fd53-49a7-bef8-d921b6d2e8d2 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 200 len: 1331 microversion: 2.1 time: 0.103946 May 25 16:13:16.810384 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 331/674] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:16 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:17.412160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e07a8afb-ab26-4b59-b1dd-108d31eff786 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:17.413160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e07a8afb-ab26-4b59-b1dd-108d31eff786 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:17.423469 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e07a8afb-ab26-4b59-b1dd-108d31eff786 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:17.423949 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e07a8afb-ab26-4b59-b1dd-108d31eff786 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:17.424723 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e07a8afb-ab26-4b59-b1dd-108d31eff786 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:17.425157 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e07a8afb-ab26-4b59-b1dd-108d31eff786 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:17.561420 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e07a8afb-ab26-4b59-b1dd-108d31eff786 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:17.569347 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e07a8afb-ab26-4b59-b1dd-108d31eff786 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1549 microversion: 2.1 time: 0.163615 May 25 16:13:17.573780 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 344/675] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:17 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:17.585865 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f33f1587-eedb-4fdd-9ff1-7e94de747cae tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:17.586370 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f33f1587-eedb-4fdd-9ff1-7e94de747cae tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:17.593224 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f33f1587-eedb-4fdd-9ff1-7e94de747cae tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:17.593724 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f33f1587-eedb-4fdd-9ff1-7e94de747cae tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:17.594722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f33f1587-eedb-4fdd-9ff1-7e94de747cae tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:17.595142 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f33f1587-eedb-4fdd-9ff1-7e94de747cae tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:17.674089 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f33f1587-eedb-4fdd-9ff1-7e94de747cae tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092067 May 25 16:13:17.674993 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 332/676] 10.222.0.85 () {58 vars in 1274 bytes} [Wed May 25 16:13:17 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:17.827317 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:17.827560 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:17.834054 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:17.834637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:17.835491 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:17.836047 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:17.851468 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 HTTP/1.1 May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:13:17.853238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:13:17.854823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '45665f8b-ba12-41a5-8ba1-43b9dcd8e166'} May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:13:17.855794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:13:17.857223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:13:17.858721 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:13:17.858721 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9c85f2f1-7b6c-4cf7-987e-94cb796b8a1b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 404 len: 111 microversion: 2.1 time: 0.031749 May 25 16:13:17.858721 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 345/677] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:17 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:13:17.864565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2dfdf31f-ef34-40ca-81f0-6eb5888c015d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '.version_select at 0x7fbae3e29430>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:17.884069 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2dfdf31f-ef34-40ca-81f0-6eb5888c015d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-841958060" status: 202 len: 0 microversion: 2.1 time: 0.023716 May 25 16:13:17.884928 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 333/678] 10.222.0.85 () {58 vars in 1217 bytes} [Wed May 25 16:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-841958060 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:13:18.558322 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-efcffd6a-ec62-4a18-a799-c7d89b6c43d1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: .version_select at 0x7fbae3e2e8b0>, body: {"keypair": {"name": "tempest-keypair-476279639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfsnfalrxP0fRhd2rk+/HCnF+berqCfGDzvrkJ7A4QLlKZc5sBbDtBQND7aNIuIbnvFrYqK4pz1c24k+xRUvmflq5r/G27riw6R9rEmqLW55JJmTAZVFg2pkzPICsafrA=="}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:18.576277 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-efcffd6a-ec62-4a18-a799-c7d89b6c43d1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for project 32e48e8e884b4840ba54d546d82d2334. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:13:18.581489 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-efcffd6a-ec62-4a18-a799-c7d89b6c43d1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for user 708fdc537e1747d7bd5917ed7af9c368 and project 32e48e8e884b4840ba54d546d82d2334. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:13:18.607632 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-efcffd6a-ec62-4a18-a799-c7d89b6c43d1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054442 May 25 16:13:18.608754 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 346/679] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:13:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:18.721838 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-7e49af8d-0951-4b71-bd45-c40f94b8b653 req-12029af8-c1a0-4b85-b2a4-dd7a7f36825c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d82389-e0ca-4a82-98ae-47c6eac2a000", "tag": "1ba0185d-8af8-486d-89b0-0ed2b1f893a5"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:18.731683 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-7e49af8d-0951-4b71-bd45-c40f94b8b653 req-12029af8-c1a0-4b85-b2a4-dd7a7f36825c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:18.732412 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-7e49af8d-0951-4b71-bd45-c40f94b8b653 req-12029af8-c1a0-4b85-b2a4-dd7a7f36825c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:18.744774 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-7e49af8d-0951-4b71-bd45-c40f94b8b653 req-12029af8-c1a0-4b85-b2a4-dd7a7f36825c service nova] Creating event network-changed:1ba0185d-8af8-486d-89b0-0ed2b1f893a5 for instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 on hv-cinder-84327 May 25 16:13:18.751645 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-7e49af8d-0951-4b71-bd45-c40f94b8b653 req-12029af8-c1a0-4b85-b2a4-dd7a7f36825c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034034 May 25 16:13:18.752871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 334/680] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:19.459042 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9c9c09b0-577d-4cf3-9f8a-4e2ccc145bec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:19.460053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9c9c09b0-577d-4cf3-9f8a-4e2ccc145bec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:19.467397 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9c9c09b0-577d-4cf3-9f8a-4e2ccc145bec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:19.468116 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9c9c09b0-577d-4cf3-9f8a-4e2ccc145bec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:19.469069 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9c9c09b0-577d-4cf3-9f8a-4e2ccc145bec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:19.469677 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9c9c09b0-577d-4cf3-9f8a-4e2ccc145bec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:19.495218 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9c9c09b0-577d-4cf3-9f8a-4e2ccc145bec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/ips" status: 200 len: 153 microversion: 2.20 time: 0.250096 May 25 16:13:19.495783 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 347/681] 10.222.0.85 () {60 vars in 1288 bytes} [Wed May 25 16:13:19 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/ips => generated 153 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:13:20.309222 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-592092717", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2dc3f38-efe8-41d0-ba54-fbd07705ad76"}], "security_groups": [{"name": "tempest-securitygroup--1786248996"}], "key_name": "tempest-keypair-476279639", "user_data": "}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:20.462664 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] validate_networks() for [('a2dc3f38-efe8-41d0-ba54-fbd07705ad76', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:13:20.986511 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:13:20.986886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:13:20.987356 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:13:20.987805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:13:20.988189 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:13:20.997789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:20.998182 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:20.999095 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:20.999545 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:21.017819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for project 32e48e8e884b4840ba54d546d82d2334. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:13:21.022203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Getting quotas for user 708fdc537e1747d7bd5917ed7af9c368 and project 32e48e8e884b4840ba54d546d82d2334. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:13:21.034655 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:13:21.037110 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:13:21.092383 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-97b02f48-ad07-420b-9d37-ad9faa9e174e tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.788370 May 25 16:13:21.098233 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 335/682] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:13:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:13:21.103739 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-24ef8702-7457-43a4-b7c8-39ce427ceb69 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:21.104379 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-24ef8702-7457-43a4-b7c8-39ce427ceb69 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:21.164881 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-24ef8702-7457-43a4-b7c8-39ce427ceb69 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:21.174110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-24ef8702-7457-43a4-b7c8-39ce427ceb69 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1240 microversion: 2.1 time: 0.073580 May 25 16:13:21.189932 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 348/683] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:21 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:21.342567 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f7ebc262-d962-4cab-ac35-fff425e1b955 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:21.343275 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f7ebc262-d962-4cab-ac35-fff425e1b955 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:21.350668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f7ebc262-d962-4cab-ac35-fff425e1b955 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:21.351393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f7ebc262-d962-4cab-ac35-fff425e1b955 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:21.352486 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f7ebc262-d962-4cab-ac35-fff425e1b955 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:21.353219 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f7ebc262-d962-4cab-ac35-fff425e1b955 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:21.381700 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-f7ebc262-d962-4cab-ac35-fff425e1b955 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lazy-loading 'flavor' on Instance uuid a3262238-f19e-4c85-b637-99459fd0e59c {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:13:21.680757 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f7ebc262-d962-4cab-ac35-fff425e1b955 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/action" status: 202 len: 0 microversion: 2.20 time: 0.342074 May 25 16:13:21.681390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 336/684] 10.222.0.85 () {62 vars in 1318 bytes} [Wed May 25 16:13:21 2022] POST /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:13:21.692807 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:21.693479 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:21.701084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:21.701532 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:21.702491 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:21.702923 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:22.085464 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:22.094250 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:22.096035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:22.097255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a74136f4-e569-4145-a4cd-ba3d539cb632 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.411206 May 25 16:13:22.097888 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 349/685] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:21 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:13:22.206068 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-84a48ced-63a8-406e-98fe-8d82a37db42b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:22.207039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-84a48ced-63a8-406e-98fe-8d82a37db42b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:22.217728 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-84a48ced-63a8-406e-98fe-8d82a37db42b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:22.218877 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-84a48ced-63a8-406e-98fe-8d82a37db42b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:22.220018 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-84a48ced-63a8-406e-98fe-8d82a37db42b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:22.220652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-84a48ced-63a8-406e-98fe-8d82a37db42b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:22.227216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:22.321318 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-84a48ced-63a8-406e-98fe-8d82a37db42b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:22.331859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-84a48ced-63a8-406e-98fe-8d82a37db42b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1300 microversion: 2.1 time: 0.133750 May 25 16:13:22.343846 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 337/686] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:22 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:23.116760 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:23.117577 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:23.124573 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:23.125218 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:23.126117 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:23.126664 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:23.348033 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:23.350382 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3da181dd-8d45-4304-88e9-bb849ae79f12 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:23.351052 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3da181dd-8d45-4304-88e9-bb849ae79f12 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:23.357537 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:23.357833 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3da181dd-8d45-4304-88e9-bb849ae79f12 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:23.358500 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3da181dd-8d45-4304-88e9-bb849ae79f12 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:23.359029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:23.359312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3da181dd-8d45-4304-88e9-bb849ae79f12 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:23.359940 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3da181dd-8d45-4304-88e9-bb849ae79f12 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:23.360286 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-72dd674e-e7eb-41a5-ad71-12af06986944 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.247593 May 25 16:13:23.361048 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 350/687] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:23 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:23.502538 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3da181dd-8d45-4304-88e9-bb849ae79f12 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:23.515650 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3da181dd-8d45-4304-88e9-bb849ae79f12 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1366 microversion: 2.1 time: 0.169789 May 25 16:13:23.525305 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 338/688] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:23 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:23.896079 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-d5a48a6e-0295-4861-a9c8-bb647bdf0d0c req-89f8949e-00f1-42d6-be0e-69912b89b141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c190734-ecd1-4f6b-9773-15cc8410902b", "tag": "2023d7e0-2db9-47f7-9275-9c71e254f1b9"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:23.905894 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-d5a48a6e-0295-4861-a9c8-bb647bdf0d0c req-89f8949e-00f1-42d6-be0e-69912b89b141 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:23.906405 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-d5a48a6e-0295-4861-a9c8-bb647bdf0d0c req-89f8949e-00f1-42d6-be0e-69912b89b141 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:23.918845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-d5a48a6e-0295-4861-a9c8-bb647bdf0d0c req-89f8949e-00f1-42d6-be0e-69912b89b141 service nova] Creating event network-changed:2023d7e0-2db9-47f7-9275-9c71e254f1b9 for instance 0c190734-ecd1-4f6b-9773-15cc8410902b on hv-cinder-84327 May 25 16:13:23.923858 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-d5a48a6e-0295-4861-a9c8-bb647bdf0d0c req-89f8949e-00f1-42d6-be0e-69912b89b141 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178866 May 25 16:13:23.925107 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 351/689] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:24.381861 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:24.382461 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:24.389381 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:24.389825 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:24.390574 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:24.391006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:24.528286 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:24.533760 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c5ffed2b-44b7-4355-a539-29980b71f3df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:24.534545 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c5ffed2b-44b7-4355-a539-29980b71f3df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:24.536360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:24.537853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:24.539005 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-39127afb-0ba9-4a55-9ba2-231559049d9f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.161264 May 25 16:13:24.539583 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 339/690] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:24 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:24.541834 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c5ffed2b-44b7-4355-a539-29980b71f3df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:24.542290 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c5ffed2b-44b7-4355-a539-29980b71f3df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:24.543061 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c5ffed2b-44b7-4355-a539-29980b71f3df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:24.543499 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c5ffed2b-44b7-4355-a539-29980b71f3df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:24.679715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c5ffed2b-44b7-4355-a539-29980b71f3df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:24.687369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c5ffed2b-44b7-4355-a539-29980b71f3df tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1366 microversion: 2.1 time: 0.157956 May 25 16:13:24.687924 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 352/691] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:24 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:13:25.561615 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:25.562455 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:25.573451 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:25.574196 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:25.575452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:25.576232 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:25.706166 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-32d62606-fc09-4ffb-bf1e-ac3b3550b4d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:25.706821 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-32d62606-fc09-4ffb-bf1e-ac3b3550b4d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:25.715343 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-32d62606-fc09-4ffb-bf1e-ac3b3550b4d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:25.717792 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-32d62606-fc09-4ffb-bf1e-ac3b3550b4d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:25.718855 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-32d62606-fc09-4ffb-bf1e-ac3b3550b4d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:25.719282 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:25.719443 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-32d62606-fc09-4ffb-bf1e-ac3b3550b4d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:25.732929 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:25.734544 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:25.735994 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3d775995-a353-4ecb-bec1-e839ac4b64e2 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.180939 May 25 16:13:25.736732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 340/692] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:25 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:25.858324 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-32d62606-fc09-4ffb-bf1e-ac3b3550b4d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:25.865857 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-32d62606-fc09-4ffb-bf1e-ac3b3550b4d4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1366 microversion: 2.1 time: 0.164875 May 25 16:13:25.866397 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 353/693] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:25 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:26.761147 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:26.762147 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:26.774357 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:26.775091 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:26.776411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:26.777129 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:26.886780 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ea6e732c-7273-4d66-933b-a5107bc01031 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:26.888018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ea6e732c-7273-4d66-933b-a5107bc01031 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:26.894558 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ea6e732c-7273-4d66-933b-a5107bc01031 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:26.895112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ea6e732c-7273-4d66-933b-a5107bc01031 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:26.896060 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ea6e732c-7273-4d66-933b-a5107bc01031 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:26.896602 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ea6e732c-7273-4d66-933b-a5107bc01031 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:26.913594 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:26.921712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:26.923204 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:26.924722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-73bb82dd-396e-4d65-81cf-a027ca349726 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.170440 May 25 16:13:26.925255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 341/694] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:26 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:27.049655 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ea6e732c-7273-4d66-933b-a5107bc01031 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:27.056842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ea6e732c-7273-4d66-933b-a5107bc01031 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1366 microversion: 2.1 time: 0.174492 May 25 16:13:27.057412 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 354/695] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:26 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:27.942980 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:27.943985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:27.950468 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:27.950936 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:27.951685 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:27.952185 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:28.073357 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-df22b553-4d09-4686-a803-a0bfad48da9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:28.073978 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-df22b553-4d09-4686-a803-a0bfad48da9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:28.082022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-df22b553-4d09-4686-a803-a0bfad48da9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:28.082476 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-df22b553-4d09-4686-a803-a0bfad48da9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:28.083263 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-df22b553-4d09-4686-a803-a0bfad48da9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:28.083701 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-df22b553-4d09-4686-a803-a0bfad48da9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:28.109102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:28.120116 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:28.121818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:28.122992 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e0d46cdf-6965-433c-9873-d66b94a93e1e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.184156 May 25 16:13:28.123719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 342/696] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:27 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:28.271032 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-df22b553-4d09-4686-a803-a0bfad48da9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:28.282263 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-df22b553-4d09-4686-a803-a0bfad48da9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1366 microversion: 2.1 time: 0.212661 May 25 16:13:28.282862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 355/697] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:28 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:13:29.145505 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:29.146165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:29.153815 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:29.154316 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:29.155168 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:29.155652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:29.297578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:29.299418 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6026f9a8-f85e-4eea-84b8-168c0e7906c1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:29.300645 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6026f9a8-f85e-4eea-84b8-168c0e7906c1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:29.306226 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:29.307719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:29.308908 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-66a4cc73-e3f8-400d-b7d2-9cd73e0f9b7a tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.169438 May 25 16:13:29.312880 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 343/698] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:29 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:29.313164 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6026f9a8-f85e-4eea-84b8-168c0e7906c1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:29.313164 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6026f9a8-f85e-4eea-84b8-168c0e7906c1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:29.313164 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6026f9a8-f85e-4eea-84b8-168c0e7906c1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:29.313164 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6026f9a8-f85e-4eea-84b8-168c0e7906c1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:29.445012 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6026f9a8-f85e-4eea-84b8-168c0e7906c1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:29.452959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6026f9a8-f85e-4eea-84b8-168c0e7906c1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1366 microversion: 2.1 time: 0.158019 May 25 16:13:29.453498 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 356/699] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:29 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:30.326935 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:30.327548 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:30.334595 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:30.335046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:30.335841 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:30.336281 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:30.466205 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:30.470482 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7e6d9780-691b-4ddb-a77c-8a13079a487a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:30.471097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-7e6d9780-691b-4ddb-a77c-8a13079a487a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:30.474658 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:30.476203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:30.477359 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-afc89a88-a7a0-4abd-90cf-5a8e4ed666f6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.154553 May 25 16:13:30.477928 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 344/700] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:30 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:30.478050 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7e6d9780-691b-4ddb-a77c-8a13079a487a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:30.478392 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7e6d9780-691b-4ddb-a77c-8a13079a487a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:30.479165 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7e6d9780-691b-4ddb-a77c-8a13079a487a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:30.479604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7e6d9780-691b-4ddb-a77c-8a13079a487a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:30.608357 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-7e6d9780-691b-4ddb-a77c-8a13079a487a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:30.616076 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-7e6d9780-691b-4ddb-a77c-8a13079a487a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1366 microversion: 2.1 time: 0.149727 May 25 16:13:30.616645 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 357/701] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:30 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:31.395255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:31.396807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:31.495976 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:31.496641 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:31.499512 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=6 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:31.504197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:31.504857 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:31.505813 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:31.506235 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:31.607128 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-29b4dce2-9719-438d-95c0-45077dce0b50 req-24b2a6f9-3329-433c-adfe-a5b408fd90d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c190734-ecd1-4f6b-9773-15cc8410902b", "name": "network-vif-plugged", "status": "completed", "tag": "2023d7e0-2db9-47f7-9275-9c71e254f1b9"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:31.615856 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-29b4dce2-9719-438d-95c0-45077dce0b50 req-24b2a6f9-3329-433c-adfe-a5b408fd90d3 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:31.616307 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-29b4dce2-9719-438d-95c0-45077dce0b50 req-24b2a6f9-3329-433c-adfe-a5b408fd90d3 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:31.627260 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-29b4dce2-9719-438d-95c0-45077dce0b50 req-24b2a6f9-3329-433c-adfe-a5b408fd90d3 service nova] Creating event network-vif-plugged:2023d7e0-2db9-47f7-9275-9c71e254f1b9 for instance 0c190734-ecd1-4f6b-9773-15cc8410902b on hv-cinder-84327 May 25 16:13:31.632737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-29b4dce2-9719-438d-95c0-45077dce0b50 req-24b2a6f9-3329-433c-adfe-a5b408fd90d3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242191 May 25 16:13:31.633559 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 345/702] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:31.640044 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-45d150d6-9dd6-41a9-88db-a308c24353da tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:31.640441 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-45d150d6-9dd6-41a9-88db-a308c24353da tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:31.647199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45d150d6-9dd6-41a9-88db-a308c24353da tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:31.647958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45d150d6-9dd6-41a9-88db-a308c24353da tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:31.648963 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45d150d6-9dd6-41a9-88db-a308c24353da tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:31.649584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45d150d6-9dd6-41a9-88db-a308c24353da tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:31.656297 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:31.667890 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:31.669815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:31.671468 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-22f52fb1-8c44-4df3-b2da-63d731d723d7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.179456 May 25 16:13:31.683127 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 358/703] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:31 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:31.812716 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-45d150d6-9dd6-41a9-88db-a308c24353da tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:31.821060 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-45d150d6-9dd6-41a9-88db-a308c24353da tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1366 microversion: 2.1 time: 0.185302 May 25 16:13:31.821496 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 346/704] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:31 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:32.690560 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:32.691167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:32.697875 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:32.698337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:32.699087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:32.699511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:32.832892 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:32.840929 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0d8b9448-21fd-43de-a3ce-843e3f42771d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:32.841694 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:32.842602 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0d8b9448-21fd-43de-a3ce-843e3f42771d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:32.843177 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:32.844523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-045751a5-8945-4927-8b91-4ec3fae7bb68 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.158220 May 25 16:13:32.845079 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 359/705] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:32 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:32.850804 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0d8b9448-21fd-43de-a3ce-843e3f42771d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:32.851264 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0d8b9448-21fd-43de-a3ce-843e3f42771d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:32.852254 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0d8b9448-21fd-43de-a3ce-843e3f42771d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:32.852693 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0d8b9448-21fd-43de-a3ce-843e3f42771d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:32.993477 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0d8b9448-21fd-43de-a3ce-843e3f42771d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:33.001591 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0d8b9448-21fd-43de-a3ce-843e3f42771d tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1366 microversion: 2.1 time: 0.166683 May 25 16:13:33.002166 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 347/706] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:32 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:33.865266 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:33.865833 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:33.872772 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:33.873220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:33.873987 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:33.874422 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:34.009750 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:34.017849 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:34.018524 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9c2e03d6-2b36-4b79-9298-609d619ad6b1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:34.019267 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9c2e03d6-2b36-4b79-9298-609d619ad6b1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:34.019370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:34.020496 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-95440edb-4a6b-49c0-a9d7-f7605e62c2fc tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.160651 May 25 16:13:34.021055 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 360/707] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:33 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:34.025961 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9c2e03d6-2b36-4b79-9298-609d619ad6b1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:34.026418 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9c2e03d6-2b36-4b79-9298-609d619ad6b1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:34.027230 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9c2e03d6-2b36-4b79-9298-609d619ad6b1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:34.027704 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9c2e03d6-2b36-4b79-9298-609d619ad6b1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:34.166764 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9c2e03d6-2b36-4b79-9298-609d619ad6b1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:34.176069 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9c2e03d6-2b36-4b79-9298-609d619ad6b1 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1555 microversion: 2.1 time: 0.161282 May 25 16:13:34.177881 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 348/708] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:34 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:34.196190 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-afb68e52-3461-45a6-b521-86a7de8fcc44 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:34.196683 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-afb68e52-3461-45a6-b521-86a7de8fcc44 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:34.203601 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-afb68e52-3461-45a6-b521-86a7de8fcc44 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:34.204094 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-afb68e52-3461-45a6-b521-86a7de8fcc44 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:34.204887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-afb68e52-3461-45a6-b521-86a7de8fcc44 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:34.205325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-afb68e52-3461-45a6-b521-86a7de8fcc44 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:34.288795 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-afb68e52-3461-45a6-b521-86a7de8fcc44 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097808 May 25 16:13:34.289649 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 361/709] 10.222.0.85 () {58 vars in 1274 bytes} [Wed May 25 16:13:34 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:35.038600 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:35.039190 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:35.046175 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:35.046636 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:35.047365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:35.048010 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:35.192491 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:35.200978 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:35.202583 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:35.204082 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5ed10307-98ef-410b-9123-f8e63d896671 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.169466 May 25 16:13:35.204655 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 349/710] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:35 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:35.250147 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-7bd6e701-ed3c-4059-807b-304511d18fd5 req-e463c6ac-18e3-48ca-9b90-cc8f52f3d5cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c190734-ecd1-4f6b-9773-15cc8410902b", "tag": "2023d7e0-2db9-47f7-9275-9c71e254f1b9"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:35.258573 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-7bd6e701-ed3c-4059-807b-304511d18fd5 req-e463c6ac-18e3-48ca-9b90-cc8f52f3d5cc service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:35.259010 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-7bd6e701-ed3c-4059-807b-304511d18fd5 req-e463c6ac-18e3-48ca-9b90-cc8f52f3d5cc service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:35.271240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-7bd6e701-ed3c-4059-807b-304511d18fd5 req-e463c6ac-18e3-48ca-9b90-cc8f52f3d5cc service nova] Creating event network-changed:2023d7e0-2db9-47f7-9275-9c71e254f1b9 for instance 0c190734-ecd1-4f6b-9773-15cc8410902b on hv-cinder-84327 May 25 16:13:35.276629 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-7bd6e701-ed3c-4059-807b-304511d18fd5 req-e463c6ac-18e3-48ca-9b90-cc8f52f3d5cc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030884 May 25 16:13:35.277210 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 362/711] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:36.223286 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:36.223805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:36.230501 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:36.231186 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:36.232055 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:36.232555 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:36.362318 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:36.370604 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:36.372119 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:36.373290 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-abf0d910-f3ee-4fc5-8bf1-33e63ca7f151 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.154456 May 25 16:13:36.373849 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 350/712] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:36 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:37.396245 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:37.396920 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:37.403769 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:37.404249 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:37.405016 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:37.405451 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:37.539434 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:37.543109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=100 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:37.547984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:37.549491 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:37.550751 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-595f4bf3-da05-4720-99d0-7650685fb566 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1746 microversion: 2.20 time: 0.161398 May 25 16:13:37.551320 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 363/713] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:37 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:38.573315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:38.574097 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:38.584365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:38.585046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:38.586203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:38.586870 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:38.726982 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:38.735321 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:38.736860 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:38.738017 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-dfed42a2-bd6a-44ad-8b69-ab62086b6742 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1746 microversion: 2.20 time: 0.171070 May 25 16:13:38.738578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 351/714] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:38 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:39.756753 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:39.757457 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:39.766241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:39.766769 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:39.767853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:39.768316 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:39.923116 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:39.931507 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:39.939959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:39.941221 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5b4a0fa4-1b88-44e6-b20c-7ba1ba688b11 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1741 microversion: 2.20 time: 0.188528 May 25 16:13:39.942035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 364/715] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:39 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:13:40.960998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:40.965464 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:40.977027 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:40.981263 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:40.983275 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:40.984132 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:41.356029 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:41.372558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:41.374462 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:41.375713 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7a270b5d-22b6-4c53-91dc-3d7fa6625e69 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1741 microversion: 2.20 time: 0.418736 May 25 16:13:41.389120 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 352/716] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:40 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1741 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:41.516511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-c3d355b6-4c13-4b68-af2d-a0987af3a858 req-23d6f5ab-4ccd-466a-abff-2e718006c34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3262238-f19e-4c85-b637-99459fd0e59c", "name": "network-vif-plugged", "status": "completed", "tag": "1800f2a7-7112-4dbc-b1d8-94b717a81abe"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:41.533701 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-c3d355b6-4c13-4b68-af2d-a0987af3a858 req-23d6f5ab-4ccd-466a-abff-2e718006c34f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:41.534538 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-c3d355b6-4c13-4b68-af2d-a0987af3a858 req-23d6f5ab-4ccd-466a-abff-2e718006c34f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:41.560743 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-c3d355b6-4c13-4b68-af2d-a0987af3a858 req-23d6f5ab-4ccd-466a-abff-2e718006c34f service nova] Creating event network-vif-plugged:1800f2a7-7112-4dbc-b1d8-94b717a81abe for instance a3262238-f19e-4c85-b637-99459fd0e59c on hv-cinder-84327 May 25 16:13:41.574104 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-c3d355b6-4c13-4b68-af2d-a0987af3a858 req-23d6f5ab-4ccd-466a-abff-2e718006c34f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061304 May 25 16:13:41.576963 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 365/717] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:42.396343 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:42.397034 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:42.405067 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:42.405789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:42.406794 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:42.407313 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:42.618829 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:42.628707 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:42.630893 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:42.632647 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-efea023c-4be7-4c06-9ea9-7123aacf222b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1741 microversion: 2.20 time: 0.241740 May 25 16:13:42.644824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 353/718] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:42 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:43.655574 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:43.657095 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:43.665836 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:43.666637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:43.667623 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:43.668400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:43.897264 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:43.908606 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:43.915769 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:43.919258 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-18e22eb4-30ec-407c-9200-1e76cde5694d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1741 microversion: 2.20 time: 0.266819 May 25 16:13:43.921006 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 366/719] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:43 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:44.938458 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:44.939935 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:44.951075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:44.951889 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:44.952913 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:44.953418 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:44.972971 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=100 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:45.120024 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:45.129374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:45.130885 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:45.131236 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1119354021", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "networks": [{"uuid": "d9742374-0900-4eb6-8398-b69feb343b7f"}]}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:45.132081 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-722a59d5-34fe-41c4-b8fd-63d610db37ec tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1741 microversion: 2.20 time: 0.197657 May 25 16:13:45.132638 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 354/720] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:44 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:45.150112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:45.200518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.network.neutron [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] validate_networks() for [('d9742374-0900-4eb6-8398-b69feb343b7f', None, None, None, None, None)] {{(pid=117764) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:13:45.592985 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Flavor limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:13:45.593612 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Image limits 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:13:45.594231 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Flavor pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:13:45.594785 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Image pref 0:0:0 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:13:45.595189 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.virt.hardware [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117764) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:13:45.605017 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:45.605716 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:45.606695 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:45.607125 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:45.625181 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Getting quotas for project 234b2b74107748719889e8c695484040. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:13:45.629729 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Getting quotas for user 40052f39d8ad48f3ab5af37806ebfcb3 and project 234b2b74107748719889e8c695484040. Resources: {'cores', 'ram', 'instances'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:13:45.644058 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Going to run 1 instances... {{(pid=117764) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:13:45.646764 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117764) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:13:45.692999 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-435a9d4f-d4af-4816-86f8-123729b03149 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565680 May 25 16:13:45.694195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 367/721] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 16:13:45.710814 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-95af9c8b-6767-4088-8e4c-dfb6f371bcc8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:45.711445 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-95af9c8b-6767-4088-8e4c-dfb6f371bcc8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:45.776063 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-95af9c8b-6767-4088-8e4c-dfb6f371bcc8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:45.784212 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-95af9c8b-6767-4088-8e4c-dfb6f371bcc8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1214 microversion: 2.1 time: 0.083507 May 25 16:13:45.784934 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 355/722] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:45 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:46.153605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:46.154371 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:46.166135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:46.166941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:46.168839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:46.169584 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:46.365330 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:46.379725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:46.381781 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:46.383375 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-17e83c9a-d6fc-4dfa-92a3-d7e25240dc49 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1741 microversion: 2.20 time: 0.236679 May 25 16:13:46.384790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 368/723] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:46 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:46.806171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-edfa232c-d4cf-4656-96d2-0d4896ea6e2f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:46.807320 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-edfa232c-d4cf-4656-96d2-0d4896ea6e2f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:46.810478 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:46.818299 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-edfa232c-d4cf-4656-96d2-0d4896ea6e2f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:46.819103 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-edfa232c-d4cf-4656-96d2-0d4896ea6e2f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:46.820286 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-edfa232c-d4cf-4656-96d2-0d4896ea6e2f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:46.821058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-edfa232c-d4cf-4656-96d2-0d4896ea6e2f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:46.897018 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-edfa232c-d4cf-4656-96d2-0d4896ea6e2f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:46.905821 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-edfa232c-d4cf-4656-96d2-0d4896ea6e2f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1274 microversion: 2.1 time: 0.107442 May 25 16:13:46.906456 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 356/724] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:46 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:47.405021 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:47.405622 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:47.419030 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:47.420427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:47.421670 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:47.422407 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:47.709016 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:47.722702 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:47.727053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:47.736644 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f1c6d032-9cda-4b28-b4e8-23636765c295 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1741 microversion: 2.20 time: 0.335580 May 25 16:13:47.739561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 369/725] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:47 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1741 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:47.922524 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-78881839-9ec2-4659-aa51-2d406c1fb86f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:47.924154 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-78881839-9ec2-4659-aa51-2d406c1fb86f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:47.931032 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-78881839-9ec2-4659-aa51-2d406c1fb86f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:47.931628 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-78881839-9ec2-4659-aa51-2d406c1fb86f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:47.932619 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-78881839-9ec2-4659-aa51-2d406c1fb86f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:47.933072 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-78881839-9ec2-4659-aa51-2d406c1fb86f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:48.091067 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-78881839-9ec2-4659-aa51-2d406c1fb86f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:48.100522 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-78881839-9ec2-4659-aa51-2d406c1fb86f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1314 microversion: 2.1 time: 0.181827 May 25 16:13:48.101650 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 357/726] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:47 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:48.569899 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-c32da137-b962-4e33-9939-b86f975c1933 req-363f2737-acbe-47e1-9d76-a69b3cc44a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b42427c6-919d-4192-8cac-3458c8d92f3d", "tag": "b19e24ff-304b-4cb0-bc05-98d8fd43a79e"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:48.620879 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-c32da137-b962-4e33-9939-b86f975c1933 req-363f2737-acbe-47e1-9d76-a69b3cc44a35 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:48.621914 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-c32da137-b962-4e33-9939-b86f975c1933 req-363f2737-acbe-47e1-9d76-a69b3cc44a35 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:48.643365 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-c32da137-b962-4e33-9939-b86f975c1933 req-363f2737-acbe-47e1-9d76-a69b3cc44a35 service nova] Creating event network-changed:b19e24ff-304b-4cb0-bc05-98d8fd43a79e for instance b42427c6-919d-4192-8cac-3458c8d92f3d on hv-cinder-84327 May 25 16:13:48.648524 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-c32da137-b962-4e33-9939-b86f975c1933 req-363f2737-acbe-47e1-9d76-a69b3cc44a35 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089953 May 25 16:13:48.649576 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 370/727] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:48.757924 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:48.758909 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:48.765682 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:48.767072 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:48.767868 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:48.768462 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:48.944869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:48.954518 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:48.956033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:48.958419 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0816bcbe-0d60-4150-8af7-f7bd7b98acb6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1741 microversion: 2.20 time: 0.204579 May 25 16:13:48.969856 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 358/728] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:48 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:49.118876 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f9a80c5e-9915-4269-912a-808752d40845 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:49.119714 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f9a80c5e-9915-4269-912a-808752d40845 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:49.126948 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9a80c5e-9915-4269-912a-808752d40845 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:49.128373 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9a80c5e-9915-4269-912a-808752d40845 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:49.129453 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9a80c5e-9915-4269-912a-808752d40845 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:49.130033 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f9a80c5e-9915-4269-912a-808752d40845 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:49.275500 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f9a80c5e-9915-4269-912a-808752d40845 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:49.283851 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f9a80c5e-9915-4269-912a-808752d40845 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1314 microversion: 2.1 time: 0.169235 May 25 16:13:49.284535 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 371/729] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:49 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:49.981298 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:49.982138 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:49.993215 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:49.993948 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:49.995185 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:49.995912 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:50.129033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:50.137635 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:50.139124 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:50.140322 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ed758e22-5357-446c-85fd-3c96b0d476b7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1741 microversion: 2.20 time: 0.166117 May 25 16:13:50.140919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 359/730] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:49 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:50.313154 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a0db05d6-71a4-4591-ab1f-a051673ab2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:50.313906 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a0db05d6-71a4-4591-ab1f-a051673ab2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:50.321884 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a0db05d6-71a4-4591-ab1f-a051673ab2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:50.322413 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a0db05d6-71a4-4591-ab1f-a051673ab2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:50.323311 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a0db05d6-71a4-4591-ab1f-a051673ab2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:50.323846 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a0db05d6-71a4-4591-ab1f-a051673ab2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:50.488524 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a0db05d6-71a4-4591-ab1f-a051673ab2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:50.499850 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a0db05d6-71a4-4591-ab1f-a051673ab2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1314 microversion: 2.1 time: 0.191236 May 25 16:13:50.500682 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 372/731] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:50 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:51.158817 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:51.159867 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:51.166829 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:51.167192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:51.167986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:51.168421 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:51.308075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:51.316244 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:51.317824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:51.318996 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5808adc5-bd0c-4bb3-a26a-f2477945c662 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1723 microversion: 2.20 time: 0.164343 May 25 16:13:51.319560 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 360/732] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:51 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:51.518303 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9f6a47ee-018f-4223-9f7a-02f5081df413 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:51.519117 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9f6a47ee-018f-4223-9f7a-02f5081df413 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:51.528234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9f6a47ee-018f-4223-9f7a-02f5081df413 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:51.529768 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9f6a47ee-018f-4223-9f7a-02f5081df413 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:51.530587 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9f6a47ee-018f-4223-9f7a-02f5081df413 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:51.531022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9f6a47ee-018f-4223-9f7a-02f5081df413 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:51.682621 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9f6a47ee-018f-4223-9f7a-02f5081df413 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:51.692156 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9f6a47ee-018f-4223-9f7a-02f5081df413 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1314 microversion: 2.1 time: 0.178602 May 25 16:13:51.692743 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 373/733] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:51 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:52.341581 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:52.342826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:52.354360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:52.355108 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:52.356433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:52.357162 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:52.495363 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:52.506788 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:52.509331 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:52.511091 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fa26aa14-0149-4554-bfa0-d429d3fe242b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1723 microversion: 2.20 time: 0.175882 May 25 16:13:52.511785 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 361/734] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:52 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:52.710437 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b81c9ed1-3b02-4117-8013-e6680c6acbe5 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:52.711025 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b81c9ed1-3b02-4117-8013-e6680c6acbe5 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:52.718053 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b81c9ed1-3b02-4117-8013-e6680c6acbe5 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:52.718501 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b81c9ed1-3b02-4117-8013-e6680c6acbe5 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:52.719248 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b81c9ed1-3b02-4117-8013-e6680c6acbe5 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:52.719675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b81c9ed1-3b02-4117-8013-e6680c6acbe5 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:53.015126 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b81c9ed1-3b02-4117-8013-e6680c6acbe5 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:53.023003 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b81c9ed1-3b02-4117-8013-e6680c6acbe5 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1314 microversion: 2.1 time: 0.316465 May 25 16:13:53.023577 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 374/735] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:52 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:53.497442 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-e9e287a1-9de1-48d2-8fea-ba498836be0c req-85b3e4a0-ad93-4630-aa08-1885cac302e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b42427c6-919d-4192-8cac-3458c8d92f3d", "name": "network-vif-plugged", "status": "completed", "tag": "b19e24ff-304b-4cb0-bc05-98d8fd43a79e"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:53.507147 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-e9e287a1-9de1-48d2-8fea-ba498836be0c req-85b3e4a0-ad93-4630-aa08-1885cac302e5 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:53.507964 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-e9e287a1-9de1-48d2-8fea-ba498836be0c req-85b3e4a0-ad93-4630-aa08-1885cac302e5 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:53.522168 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-e9e287a1-9de1-48d2-8fea-ba498836be0c req-85b3e4a0-ad93-4630-aa08-1885cac302e5 service nova] Creating event network-vif-plugged:b19e24ff-304b-4cb0-bc05-98d8fd43a79e for instance b42427c6-919d-4192-8cac-3458c8d92f3d on hv-cinder-84327 May 25 16:13:53.527848 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-e9e287a1-9de1-48d2-8fea-ba498836be0c req-85b3e4a0-ad93-4630-aa08-1885cac302e5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034479 May 25 16:13:53.528610 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 362/736] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:13:53.532922 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:53.533552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:53.557159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:53.557961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:53.559180 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:53.560394 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:53.857269 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:53.866132 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:53.867620 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:53.868778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-33541006-f821-4ca1-ae82-10fd5d0ebe62 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1726 microversion: 2.20 time: 0.339759 May 25 16:13:53.869592 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 375/737] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:53 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1726 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:53.887534 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7600c841-2845-430d-9e82-055a736948f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f37a1ed-2a6e-4943-b26d-85e86c005e0c"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:53.888736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7600c841-2845-430d-9e82-055a736948f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:53.895058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7600c841-2845-430d-9e82-055a736948f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:53.895502 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7600c841-2845-430d-9e82-055a736948f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:53.896330 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7600c841-2845-430d-9e82-055a736948f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:53.896755 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7600c841-2845-430d-9e82-055a736948f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:54.042007 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-52f59d68-8457-4888-af6f-b9006fa66418 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:54.042643 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-52f59d68-8457-4888-af6f-b9006fa66418 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:54.049248 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-52f59d68-8457-4888-af6f-b9006fa66418 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:54.049827 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-52f59d68-8457-4888-af6f-b9006fa66418 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:54.050655 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-52f59d68-8457-4888-af6f-b9006fa66418 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:54.051118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-52f59d68-8457-4888-af6f-b9006fa66418 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:54.191607 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-52f59d68-8457-4888-af6f-b9006fa66418 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:54.199356 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-52f59d68-8457-4888-af6f-b9006fa66418 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1314 microversion: 2.1 time: 0.163157 May 25 16:13:54.199936 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 376/738] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:54 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:13:54.209030 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7600c841-2845-430d-9e82-055a736948f3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324456 May 25 16:13:54.209030 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 363/739] 10.222.0.85 () {62 vars in 1363 bytes} [Wed May 25 16:13:53 2022] POST /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 16:13:54.326647 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8f2de563-a117-4e3e-90f7-74ed59e027be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:54.327144 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8f2de563-a117-4e3e-90f7-74ed59e027be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:54.333917 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f2de563-a117-4e3e-90f7-74ed59e027be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:54.334372 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f2de563-a117-4e3e-90f7-74ed59e027be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:54.335137 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f2de563-a117-4e3e-90f7-74ed59e027be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:54.335572 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f2de563-a117-4e3e-90f7-74ed59e027be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:54.566111 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8f2de563-a117-4e3e-90f7-74ed59e027be tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/os-volume_attachments/1f37a1ed-2a6e-4943-b26d-85e86c005e0c" status: 202 len: 0 microversion: 2.20 time: 0.243448 May 25 16:13:54.566749 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 364/740] 10.222.0.85 () {60 vars in 1456 bytes} [Wed May 25 16:13:54 2022] DELETE /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/os-volume_attachments/1f37a1ed-2a6e-4943-b26d-85e86c005e0c => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:13:54.624829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f3d505c4-173f-4f2f-a9f4-e6ca2ece86c8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:54.625389 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f3d505c4-173f-4f2f-a9f4-e6ca2ece86c8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:54.631588 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f3d505c4-173f-4f2f-a9f4-e6ca2ece86c8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:54.632076 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f3d505c4-173f-4f2f-a9f4-e6ca2ece86c8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:54.632829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f3d505c4-173f-4f2f-a9f4-e6ca2ece86c8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:54.633577 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f3d505c4-173f-4f2f-a9f4-e6ca2ece86c8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:54.712315 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f3d505c4-173f-4f2f-a9f4-e6ca2ece86c8 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "POST /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/action" status: 202 len: 0 microversion: 2.20 time: 0.091534 May 25 16:13:54.712890 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 377/741] 10.222.0.85 () {62 vars in 1318 bytes} [Wed May 25 16:13:54 2022] POST /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 16:13:54.721591 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:54.722369 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:54.729486 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:54.729935 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:54.730712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:54.731140 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:54.875390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:54.883949 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:54.886252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:54.887611 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e149db20-12ce-45e7-b5e8-d39b0639062c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1674 microversion: 2.20 time: 0.170549 May 25 16:13:54.888345 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 365/742] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:54 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:55.217094 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-fe2024b6-71b9-4fb0-9b66-8d9983e36f8f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:55.217692 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-fe2024b6-71b9-4fb0-9b66-8d9983e36f8f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:55.224297 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fe2024b6-71b9-4fb0-9b66-8d9983e36f8f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:55.224766 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fe2024b6-71b9-4fb0-9b66-8d9983e36f8f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:55.225500 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fe2024b6-71b9-4fb0-9b66-8d9983e36f8f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:55.225927 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fe2024b6-71b9-4fb0-9b66-8d9983e36f8f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:55.360864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-fe2024b6-71b9-4fb0-9b66-8d9983e36f8f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:55.368620 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-fe2024b6-71b9-4fb0-9b66-8d9983e36f8f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1314 microversion: 2.1 time: 0.155475 May 25 16:13:55.369172 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 378/743] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:55 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:55.583003 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-35e430b6-68f7-4dae-8efc-bb2a1dd91b2e req-e520424e-bee5-4364-b7e5-f9346ba4803b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3262238-f19e-4c85-b637-99459fd0e59c", "name": "network-vif-unplugged", "status": "completed", "tag": "1800f2a7-7112-4dbc-b1d8-94b717a81abe"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:55.592353 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-35e430b6-68f7-4dae-8efc-bb2a1dd91b2e req-e520424e-bee5-4364-b7e5-f9346ba4803b service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:55.592800 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-35e430b6-68f7-4dae-8efc-bb2a1dd91b2e req-e520424e-bee5-4364-b7e5-f9346ba4803b service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:55.604365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.compute.server_external_events [req-35e430b6-68f7-4dae-8efc-bb2a1dd91b2e req-e520424e-bee5-4364-b7e5-f9346ba4803b service nova] Unable to find a host for instance a3262238-f19e-4c85-b637-99459fd0e59c. Dropping event network-vif-unplugged {{(pid=117763) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 16:13:55.605222 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-35e430b6-68f7-4dae-8efc-bb2a1dd91b2e req-e520424e-bee5-4364-b7e5-f9346ba4803b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028784 May 25 16:13:55.605789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 366/744] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 25 16:13:55.906646 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:55.907396 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:55.909456 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:55.910732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=6 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:55.916596 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:55.917141 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:55.917879 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:55.918347 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:56.049989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:56.058270 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:56.059765 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:56.060962 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-28f4fd60-3ba0-44d3-a361-3aeec6e40530 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1676 microversion: 2.20 time: 0.158296 May 25 16:13:56.061520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 379/745] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:55 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:56.386220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-da39a8d4-85c9-4fe4-b29c-116f61e8d43f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:56.387006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-da39a8d4-85c9-4fe4-b29c-116f61e8d43f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:56.389239 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:56.394801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da39a8d4-85c9-4fe4-b29c-116f61e8d43f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:56.395241 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da39a8d4-85c9-4fe4-b29c-116f61e8d43f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:56.396111 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da39a8d4-85c9-4fe4-b29c-116f61e8d43f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:56.396546 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da39a8d4-85c9-4fe4-b29c-116f61e8d43f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:56.527267 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-da39a8d4-85c9-4fe4-b29c-116f61e8d43f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:56.534912 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-da39a8d4-85c9-4fe4-b29c-116f61e8d43f tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1498 microversion: 2.1 time: 0.152983 May 25 16:13:56.535476 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 367/746] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:56 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:56.952932 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2e9dc280-2ec2-48c6-8113-2042fd372959 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:56.953508 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2e9dc280-2ec2-48c6-8113-2042fd372959 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:56.961271 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2e9dc280-2ec2-48c6-8113-2042fd372959 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:56.961705 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2e9dc280-2ec2-48c6-8113-2042fd372959 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:56.962487 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2e9dc280-2ec2-48c6-8113-2042fd372959 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:56.962913 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2e9dc280-2ec2-48c6-8113-2042fd372959 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:56.990815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2e9dc280-2ec2-48c6-8113-2042fd372959 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:13:57.019560 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:57.073717 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2e9dc280-2ec2-48c6-8113-2042fd372959 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 204 len: 0 microversion: 2.1 time: 0.124036 May 25 16:13:57.074512 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 380/747] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:13:56 2022] DELETE /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:13:57.080520 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:57.081316 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:57.083326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-82b19f97-4f55-4695-9c9f-474cdb0d8772 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:57.084088 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-82b19f97-4f55-4695-9c9f-474cdb0d8772 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:57.090259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:57.090755 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-82b19f97-4f55-4695-9c9f-474cdb0d8772 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:57.091207 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-82b19f97-4f55-4695-9c9f-474cdb0d8772 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:57.092074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-82b19f97-4f55-4695-9c9f-474cdb0d8772 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:57.093006 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-82b19f97-4f55-4695-9c9f-474cdb0d8772 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:57.093681 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:57.094664 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:57.095674 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:57.119490 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:57.232368 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:57.240743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:57.242252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:57.243427 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9caf5c9a-3590-4659-9b20-e7e35e5bb973 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.167536 May 25 16:13:57.243991 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 368/748] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:57 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:13:57.287542 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-82b19f97-4f55-4695-9c9f-474cdb0d8772 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:57.295601 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-82b19f97-4f55-4695-9c9f-474cdb0d8772 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1504 microversion: 2.1 time: 0.216636 May 25 16:13:57.296168 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 381/749] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:57 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:13:58.265637 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:58.266626 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:58.275003 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:58.275455 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:58.276256 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:58.276692 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:58.314385 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4a62f75d-95d2-4a9b-9e9d-536b89e4bec6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:58.315141 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4a62f75d-95d2-4a9b-9e9d-536b89e4bec6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:58.322096 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4a62f75d-95d2-4a9b-9e9d-536b89e4bec6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:58.322549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4a62f75d-95d2-4a9b-9e9d-536b89e4bec6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:58.323319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4a62f75d-95d2-4a9b-9e9d-536b89e4bec6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:58.323753 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4a62f75d-95d2-4a9b-9e9d-536b89e4bec6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:58.406422 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:58.414622 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:58.416221 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:58.417383 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-73e08783-7432-4da8-ac59-c00ceced732d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.158320 May 25 16:13:58.418269 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 369/750] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:58 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:13:58.453337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4a62f75d-95d2-4a9b-9e9d-536b89e4bec6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:58.461039 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4a62f75d-95d2-4a9b-9e9d-536b89e4bec6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1504 microversion: 2.1 time: 0.150488 May 25 16:13:58.461580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 382/751] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:58 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:59.436981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:59.437604 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:59.447815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-611b8cf3-9312-4d48-a173-6072380e386c req-e84c315e-f10f-4fb1-9486-9cac5e3265fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b42427c6-919d-4192-8cac-3458c8d92f3d", "name": "network-vif-deleted", "tag": "b19e24ff-304b-4cb0-bc05-98d8fd43a79e"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:13:59.449137 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:59.449782 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:59.450714 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:59.451305 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:59.456478 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-611b8cf3-9312-4d48-a173-6072380e386c req-e84c315e-f10f-4fb1-9486-9cac5e3265fd service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:59.457268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-611b8cf3-9312-4d48-a173-6072380e386c req-e84c315e-f10f-4fb1-9486-9cac5e3265fd service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:59.468909 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-611b8cf3-9312-4d48-a173-6072380e386c req-e84c315e-f10f-4fb1-9486-9cac5e3265fd service nova] Creating event network-vif-deleted:b19e24ff-304b-4cb0-bc05-98d8fd43a79e for instance b42427c6-919d-4192-8cac-3458c8d92f3d on hv-cinder-84327 May 25 16:13:59.484646 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-611b8cf3-9312-4d48-a173-6072380e386c req-e84c315e-f10f-4fb1-9486-9cac5e3265fd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040741 May 25 16:13:59.489175 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 383/752] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:13:59.494490 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c73f3062-0cca-4d96-be2e-6323d6866e7d tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:13:59.495388 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c73f3062-0cca-4d96-be2e-6323d6866e7d tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:13:59.502094 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c73f3062-0cca-4d96-be2e-6323d6866e7d tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:59.502794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c73f3062-0cca-4d96-be2e-6323d6866e7d tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:59.503714 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c73f3062-0cca-4d96-be2e-6323d6866e7d tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:13:59.504415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c73f3062-0cca-4d96-be2e-6323d6866e7d tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:13:59.571429 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c73f3062-0cca-4d96-be2e-6323d6866e7d tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:59.579851 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c73f3062-0cca-4d96-be2e-6323d6866e7d tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1462 microversion: 2.1 time: 0.089320 May 25 16:13:59.580685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 384/753] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:13:59 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:13:59.644315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:59.658036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:59.660402 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:13:59.662208 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4eb02874-1d96-46cd-820f-eb72e4fe1622 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.230325 May 25 16:13:59.662788 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 370/754] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:13:59 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:00.597566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-628c36dc-368a-4d77-b097-a6e49b1f3b33 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:00.598111 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-628c36dc-368a-4d77-b097-a6e49b1f3b33 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:00.605231 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-628c36dc-368a-4d77-b097-a6e49b1f3b33 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:00.605675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-628c36dc-368a-4d77-b097-a6e49b1f3b33 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:00.606470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-628c36dc-368a-4d77-b097-a6e49b1f3b33 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:00.606963 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-628c36dc-368a-4d77-b097-a6e49b1f3b33 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:00.678940 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-628c36dc-368a-4d77-b097-a6e49b1f3b33 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:00.680483 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:00.681098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:00.686737 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-628c36dc-368a-4d77-b097-a6e49b1f3b33 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1462 microversion: 2.1 time: 0.093215 May 25 16:14:00.687389 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 385/755] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:00 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:00.687760 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:00.688244 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:00.689013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:00.689450 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:00.824094 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:00.832886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:00.834414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:00.835576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7634f1cb-4b02-483f-b795-839c1b91651e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.159139 May 25 16:14:00.836360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 371/756] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:00 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:14:01.704542 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3578319d-ed2d-47f3-8c47-84e913f17bf9 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:01.705169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3578319d-ed2d-47f3-8c47-84e913f17bf9 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:01.712039 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3578319d-ed2d-47f3-8c47-84e913f17bf9 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:01.712500 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3578319d-ed2d-47f3-8c47-84e913f17bf9 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:01.713308 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3578319d-ed2d-47f3-8c47-84e913f17bf9 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:01.713760 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3578319d-ed2d-47f3-8c47-84e913f17bf9 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:01.786220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3578319d-ed2d-47f3-8c47-84e913f17bf9 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:01.794157 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3578319d-ed2d-47f3-8c47-84e913f17bf9 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1462 microversion: 2.1 time: 0.093521 May 25 16:14:01.794949 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 386/757] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:01 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:01.854036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:01.854656 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:01.861192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:01.861648 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:01.862410 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:01.862849 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:02.007299 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:02.015869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:02.017381 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:02.018561 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-947eda3c-5959-4160-8eee-bc521965d8af tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.168496 May 25 16:14:02.019126 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 372/758] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:01 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:02.811232 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-feffeac6-d5a6-4bc6-be17-4ce087cba104 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:02.811889 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-feffeac6-d5a6-4bc6-be17-4ce087cba104 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:02.818754 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-feffeac6-d5a6-4bc6-be17-4ce087cba104 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:02.819208 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-feffeac6-d5a6-4bc6-be17-4ce087cba104 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:02.820149 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-feffeac6-d5a6-4bc6-be17-4ce087cba104 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:02.820585 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-feffeac6-d5a6-4bc6-be17-4ce087cba104 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:02.885310 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-feffeac6-d5a6-4bc6-be17-4ce087cba104 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:02.892975 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-feffeac6-d5a6-4bc6-be17-4ce087cba104 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1462 microversion: 2.1 time: 0.085684 May 25 16:14:02.893536 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 387/759] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:02 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:03.038025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:03.038794 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:03.046807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:03.047617 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:03.048538 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:03.049180 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:03.184511 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:03.192572 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:03.194065 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:03.195230 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-6a6214df-234e-45fb-830e-ee0a5b41d96f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.161802 May 25 16:14:03.195801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 373/760] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:03 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:03.910325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f97de0b1-dd82-45f6-a34a-defbf34b79ef tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:03.911037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f97de0b1-dd82-45f6-a34a-defbf34b79ef tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:03.917824 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f97de0b1-dd82-45f6-a34a-defbf34b79ef tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:03.918269 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f97de0b1-dd82-45f6-a34a-defbf34b79ef tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:03.919031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f97de0b1-dd82-45f6-a34a-defbf34b79ef tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:03.919470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f97de0b1-dd82-45f6-a34a-defbf34b79ef tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:04.000637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f97de0b1-dd82-45f6-a34a-defbf34b79ef tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:04.012440 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f97de0b1-dd82-45f6-a34a-defbf34b79ef tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1462 microversion: 2.1 time: 0.105973 May 25 16:14:04.013024 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 388/761] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:03 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:04.215028 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:04.216816 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:04.225550 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:04.226345 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:04.227655 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:04.228352 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:04.378130 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:04.386992 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:04.388807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:04.390512 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1a47c54d-dfce-4704-8e47-31edc8f89ce6 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.180506 May 25 16:14:04.391322 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 374/762] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:04 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:05.030727 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6d147623-27fa-45ff-943d-37f1a87b8bc6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:05.032197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6d147623-27fa-45ff-943d-37f1a87b8bc6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:05.040364 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d147623-27fa-45ff-943d-37f1a87b8bc6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:05.041164 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d147623-27fa-45ff-943d-37f1a87b8bc6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:05.041942 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d147623-27fa-45ff-943d-37f1a87b8bc6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:05.042341 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6d147623-27fa-45ff-943d-37f1a87b8bc6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:05.117905 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6d147623-27fa-45ff-943d-37f1a87b8bc6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:05.125726 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6d147623-27fa-45ff-943d-37f1a87b8bc6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1462 microversion: 2.1 time: 0.099499 May 25 16:14:05.126310 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 389/763] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:05 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1462 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:05.411503 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:05.412765 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:05.420318 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:05.420776 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:05.421548 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:05.421997 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:05.560746 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:05.569386 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:05.570904 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:05.572099 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9a18d6e5-d702-41fd-9ce9-89e6c98ae794 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.166019 May 25 16:14:05.572671 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 375/764] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:05 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:06.145270 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7c605069-7d5c-4bf5-8233-29f422888491 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:06.147566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-7c605069-7d5c-4bf5-8233-29f422888491 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:06.156142 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7c605069-7d5c-4bf5-8233-29f422888491 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:06.156712 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7c605069-7d5c-4bf5-8233-29f422888491 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:06.157607 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7c605069-7d5c-4bf5-8233-29f422888491 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:06.158044 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7c605069-7d5c-4bf5-8233-29f422888491 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:06.237640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-7c605069-7d5c-4bf5-8233-29f422888491 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:06.246054 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-7c605069-7d5c-4bf5-8233-29f422888491 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1462 microversion: 2.1 time: 0.106606 May 25 16:14:06.246648 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 390/765] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:06 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1462 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:06.593981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:06.594907 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:06.602802 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:06.603249 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:06.604054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:06.604706 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:06.737785 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:06.746020 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:06.747517 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:06.748712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a44780ae-827b-4f3f-ae42-544996895082 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.161349 May 25 16:14:06.749278 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 376/766] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:06 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:07.264547 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4fee0ebf-56fe-4dad-a00b-0564fb48d22a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:07.265130 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4fee0ebf-56fe-4dad-a00b-0564fb48d22a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:07.272437 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4fee0ebf-56fe-4dad-a00b-0564fb48d22a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:07.273005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4fee0ebf-56fe-4dad-a00b-0564fb48d22a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:07.273787 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4fee0ebf-56fe-4dad-a00b-0564fb48d22a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:07.274346 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4fee0ebf-56fe-4dad-a00b-0564fb48d22a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:07.344194 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4fee0ebf-56fe-4dad-a00b-0564fb48d22a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:07.351980 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4fee0ebf-56fe-4dad-a00b-0564fb48d22a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1462 microversion: 2.1 time: 0.091438 May 25 16:14:07.352761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 391/767] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:07 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:07.767189 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:07.767805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:07.775260 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:07.775789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:07.776633 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:07.777075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:07.917496 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:07.928628 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:07.930152 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:07.931321 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3f936404-cf1a-4db7-9909-ab6dcaf4252c tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.168447 May 25 16:14:07.931950 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 377/768] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:07 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:08.369873 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:08.370545 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:08.377958 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:08.378420 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:08.379187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:08.379624 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:08.410598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:08.411110 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:08.411484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lazy-loading 'fault' on Instance uuid b42427c6-919d-4192-8cac-3458c8d92f3d {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:14:08.455335 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:08.463328 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-248e4395-7de2-45fd-bd39-bd747d0401f8 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 200 len: 1304 microversion: 2.1 time: 0.098022 May 25 16:14:08.463877 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 392/769] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:08 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:08.954232 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:08.955414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:08.964400 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:08.964852 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:08.965623 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:08.966064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:09.103995 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:09.112699 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:09.114191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:09.115349 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e3b9c00a-fcb9-48cd-84f9-02c6e33164c1 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.168203 May 25 16:14:09.115934 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 378/770] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:08 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:09.481332 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:09.482144 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: b42427c6-919d-4192-8cac-3458c8d92f3d] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:09.489234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:09.489699 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:09.490484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:09.490929 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:09.506551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] HTTP exception thrown: Instance b42427c6-919d-4192-8cac-3458c8d92f3d could not be found. May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Request method failure captured: May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d HTTP/1.1 May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlW3KXTau91_b2Zk9wl2C55xI8au9X6yfKdzHLg7j5tzlcvy4DBLgb3IoJd2DfqC1AmRyNIHmA0ZcGojrN_LUmJnyqj2A52avhdOZQgQnoSEQmhrRK9voUOM_wJxGA9fngJLRyHOJccMsHqv0ZoaEsg9np-70XaxTkShmabUeAxURYo May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 234b2b74107748719889e8c695484040 May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesActionsTest-1331229650 May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:14:09.508598 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_234b2b74107748719889e8c695484040", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/234b2b74107748719889e8c695484040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/234b2b74107748719889e8c695484040"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/234b2b74107748719889e8c695484040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesActionsTest-1331229650 May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 234b2b74107748719889e8c695484040 May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesActionsTest-1331229650 May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesActionsTest-1331229650-project May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 40052f39d8ad48f3ab5af37806ebfcb3 May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesActionsTest-1331229650-project May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance b42427c6-919d-4192-8cac-3458c8d92f3d could not be found. May 25 16:14:09.510255 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'b42427c6-919d-4192-8cac-3458c8d92f3d'} May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b42427c6-919d-4192-8cac-3458c8d92f3d could not be found. May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:09.511370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b42427c6-919d-4192-8cac-3458c8d92f3d could not be found. May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b42427c6-919d-4192-8cac-3458c8d92f3d could not be found. May 25 16:14:09.512915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:09.514431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Returning 404 to user: Instance b42427c6-919d-4192-8cac-3458c8d92f3d could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:09.514431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-18a852df-496d-4c05-8d1b-7bc2694d9989 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d" status: 404 len: 111 microversion: 2.1 time: 0.033002 May 25 16:14:09.514431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 393/771] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:09 2022] GET /compute/v2.1/servers/b42427c6-919d-4192-8cac-3458c8d92f3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:09.560059 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1719114775", "imageRef": "5da7d411-4433-4ad6-b38d-17a3f63f3143", "flavorRef": "452", "networks": [{"uuid": "d9742374-0900-4eb6-8398-b69feb343b7f"}]}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:09.619627 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] validate_networks() for [('d9742374-0900-4eb6-8398-b69feb343b7f', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:14:09.973488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:14:09.974376 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:14:09.974841 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:14:09.975462 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:14:09.976170 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:14:09.985579 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:09.986027 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:09.986852 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:09.987288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:10.004941 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Getting quotas for project 234b2b74107748719889e8c695484040. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:14:10.009263 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Getting quotas for user 40052f39d8ad48f3ab5af37806ebfcb3 and project 234b2b74107748719889e8c695484040. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:14:10.020495 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:14:10.022738 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5da7d411-4433-4ad6-b38d-17a3f63f3143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:14:10.069106 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-82199dfe-a557-47b4-b4db-184bfc66c7d6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512917 May 25 16:14:10.070079 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 379/772] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:14:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:14:10.080111 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c87bd2fa-10a9-402a-a1d1-2f09db1f59ba tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:10.081159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c87bd2fa-10a9-402a-a1d1-2f09db1f59ba tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:10.134315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:10.134979 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:10.140958 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c87bd2fa-10a9-402a-a1d1-2f09db1f59ba tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:10.141337 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:10.141789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:10.142558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:10.143004 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:10.148894 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c87bd2fa-10a9-402a-a1d1-2f09db1f59ba tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1214 microversion: 2.1 time: 0.072683 May 25 16:14:10.158376 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 394/773] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:10 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:10.275775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:10.285061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:10.286638 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:10.287873 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ce0214a5-7608-4a5a-9dc0-4d9feccb2af0 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.158037 May 25 16:14:10.288593 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 380/774] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:10 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 16:14:11.166318 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ddebe250-3c0d-4950-854e-8abcacd08e49 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:11.167342 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ddebe250-3c0d-4950-854e-8abcacd08e49 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:11.175515 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddebe250-3c0d-4950-854e-8abcacd08e49 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:11.176004 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddebe250-3c0d-4950-854e-8abcacd08e49 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:11.176990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddebe250-3c0d-4950-854e-8abcacd08e49 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:11.177603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddebe250-3c0d-4950-854e-8abcacd08e49 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:11.249782 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ddebe250-3c0d-4950-854e-8abcacd08e49 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:11.258195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ddebe250-3c0d-4950-854e-8abcacd08e49 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1272 microversion: 2.1 time: 0.095857 May 25 16:14:11.258959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 395/775] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:11 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:11.307353 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:11.307770 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:11.314930 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:11.315439 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:11.316250 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:11.316678 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:11.456370 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:11.465133 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:11.466719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:11.467959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-da97e17b-f2d3-4352-b185-3d049d784153 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.165650 May 25 16:14:11.468862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 381/776] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:11 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:12.277844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-90a0c2e5-c822-4ead-863d-582e2c38878a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:12.278462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-90a0c2e5-c822-4ead-863d-582e2c38878a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:12.285372 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-90a0c2e5-c822-4ead-863d-582e2c38878a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:12.285829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-90a0c2e5-c822-4ead-863d-582e2c38878a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:12.286596 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-90a0c2e5-c822-4ead-863d-582e2c38878a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:12.287037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-90a0c2e5-c822-4ead-863d-582e2c38878a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:12.443385 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-5ee36f57-d061-4b92-9195-0529dff9abda req-c2a04bd2-3d93-414b-9aa4-8f86cfdd9922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3b9edc-aaaf-4581-a1b0-5fcc7025373b", "tag": "f3bd181a-3871-4d5f-91c2-895c1bf3aa93"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:12.453721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-5ee36f57-d061-4b92-9195-0529dff9abda req-c2a04bd2-3d93-414b-9aa4-8f86cfdd9922 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:12.454546 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-5ee36f57-d061-4b92-9195-0529dff9abda req-c2a04bd2-3d93-414b-9aa4-8f86cfdd9922 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:12.466264 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-5ee36f57-d061-4b92-9195-0529dff9abda req-c2a04bd2-3d93-414b-9aa4-8f86cfdd9922 service nova] Creating event network-changed:f3bd181a-3871-4d5f-91c2-895c1bf3aa93 for instance 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b on hv-cinder-84327 May 25 16:14:12.471444 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-5ee36f57-d061-4b92-9195-0529dff9abda req-c2a04bd2-3d93-414b-9aa4-8f86cfdd9922 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032592 May 25 16:14:12.472033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 382/777] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:12.487373 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:12.488234 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:12.494881 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:12.495346 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:12.496153 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:12.496590 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:12.504981 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-90a0c2e5-c822-4ead-863d-582e2c38878a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:12.513019 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-90a0c2e5-c822-4ead-863d-582e2c38878a tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1314 microversion: 2.1 time: 0.239121 May 25 16:14:12.513591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 396/778] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:12 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:12.628984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:12.637538 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:12.639041 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:12.640230 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fc0f8220-3289-41a9-9089-c63cf95784d3 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.157107 May 25 16:14:12.641006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 383/779] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:12 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:13.530421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-83414cb0-b464-4612-9745-d4e185db84b6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:13.531035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-83414cb0-b464-4612-9745-d4e185db84b6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:13.538043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83414cb0-b464-4612-9745-d4e185db84b6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:13.538496 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83414cb0-b464-4612-9745-d4e185db84b6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:13.539057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-911fe9b1-d953-49f4-8cf7-238a7a9f07dc req-f705da90-327c-47f3-a760-8e776778a60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3262238-f19e-4c85-b637-99459fd0e59c", "name": "network-vif-plugged", "status": "completed", "tag": "1800f2a7-7112-4dbc-b1d8-94b717a81abe"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:13.539522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83414cb0-b464-4612-9745-d4e185db84b6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:13.539885 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-83414cb0-b464-4612-9745-d4e185db84b6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:13.547703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-911fe9b1-d953-49f4-8cf7-238a7a9f07dc req-f705da90-327c-47f3-a760-8e776778a60e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:13.548174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-911fe9b1-d953-49f4-8cf7-238a7a9f07dc req-f705da90-327c-47f3-a760-8e776778a60e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:13.560166 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-911fe9b1-d953-49f4-8cf7-238a7a9f07dc req-f705da90-327c-47f3-a760-8e776778a60e service nova] Creating event network-vif-plugged:1800f2a7-7112-4dbc-b1d8-94b717a81abe for instance a3262238-f19e-4c85-b637-99459fd0e59c on hv-cinder-84327 May 25 16:14:13.564975 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-911fe9b1-d953-49f4-8cf7-238a7a9f07dc req-f705da90-327c-47f3-a760-8e776778a60e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029759 May 25 16:14:13.565962 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 384/780] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:13.659252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:13.659972 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:13.666694 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:13.667134 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:13.668060 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:13.668491 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:13.680790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-83414cb0-b464-4612-9745-d4e185db84b6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:13.688465 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-83414cb0-b464-4612-9745-d4e185db84b6 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1314 microversion: 2.1 time: 0.162005 May 25 16:14:13.689005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 397/781] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:13 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:13.819989 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:13.828451 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:13.830080 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:13.831435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-39e7865b-9940-4f7c-ba73-75bf3f1f9644 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.176447 May 25 16:14:13.832614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 385/782] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:13 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:14.709811 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4166f859-4d52-4fe3-8ddb-9c110fd278f2 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:14.710719 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4166f859-4d52-4fe3-8ddb-9c110fd278f2 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:14.717897 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4166f859-4d52-4fe3-8ddb-9c110fd278f2 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:14.718348 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4166f859-4d52-4fe3-8ddb-9c110fd278f2 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:14.719109 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4166f859-4d52-4fe3-8ddb-9c110fd278f2 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:14.719643 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4166f859-4d52-4fe3-8ddb-9c110fd278f2 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:14.738337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:14.850351 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:14.850947 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:14.857815 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:14.858283 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:14.859050 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:14.859487 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:14.860310 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4166f859-4d52-4fe3-8ddb-9c110fd278f2 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:14.868292 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4166f859-4d52-4fe3-8ddb-9c110fd278f2 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1314 microversion: 2.1 time: 0.165199 May 25 16:14:14.868891 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 398/783] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:14 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:14.993811 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:15.001711 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:15.003185 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:15.004371 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-29b5e639-9ea6-4af3-a4b8-9e4881100813 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.158045 May 25 16:14:15.004898 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 386/784] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:14 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:15.886067 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-aa6aff1d-4486-4689-a1c9-52f69766678c tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:15.887219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-aa6aff1d-4486-4689-a1c9-52f69766678c tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:15.891014 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:15.896369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-aa6aff1d-4486-4689-a1c9-52f69766678c tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:15.896369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-aa6aff1d-4486-4689-a1c9-52f69766678c tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:15.896960 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-aa6aff1d-4486-4689-a1c9-52f69766678c tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:15.897395 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-aa6aff1d-4486-4689-a1c9-52f69766678c tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:16.022717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:16.023386 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:16.030054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:16.030607 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:16.031551 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:16.032279 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:16.036745 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=100 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:16.053084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-aa6aff1d-4486-4689-a1c9-52f69766678c tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:16.061056 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-aa6aff1d-4486-4689-a1c9-52f69766678c tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1314 microversion: 2.1 time: 0.179950 May 25 16:14:16.070182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 399/785] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:15 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:16.168386 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:16.177404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:16.178968 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:16.180260 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0f154a2b-67b7-4f13-ac73-63f517a0dcc7 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1732 microversion: 2.20 time: 0.161563 May 25 16:14:16.180818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 387/786] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:16 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:17.082073 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-948dce37-74a5-4aba-b48d-bf849f62c087 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:17.083035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-948dce37-74a5-4aba-b48d-bf849f62c087 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:17.090919 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-948dce37-74a5-4aba-b48d-bf849f62c087 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:17.091374 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-948dce37-74a5-4aba-b48d-bf849f62c087 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:17.092161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-948dce37-74a5-4aba-b48d-bf849f62c087 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:17.092595 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-948dce37-74a5-4aba-b48d-bf849f62c087 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:17.198712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:17.199439 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:17.202077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:17.207721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:17.208265 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:17.209107 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:17.209614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:17.237339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-948dce37-74a5-4aba-b48d-bf849f62c087 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:17.245056 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-948dce37-74a5-4aba-b48d-bf849f62c087 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1314 microversion: 2.1 time: 0.169587 May 25 16:14:17.245626 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 400/787] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:17 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:17.343300 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:17.354703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:17.356252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:17.357434 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1a44bddb-851e-4558-8ef8-c759aebaa15b tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1719 microversion: 2.20 time: 0.162754 May 25 16:14:17.358052 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 388/788] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:17 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:17.570539 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-89ed1822-05e5-4d01-8aa1-3bca4b31bebc req-c54bd17f-f370-463d-841c-a1a9ea4397b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b9edc-aaaf-4581-a1b0-5fcc7025373b", "name": "network-vif-plugged", "status": "completed", "tag": "f3bd181a-3871-4d5f-91c2-895c1bf3aa93"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:17.579481 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-89ed1822-05e5-4d01-8aa1-3bca4b31bebc req-c54bd17f-f370-463d-841c-a1a9ea4397b4 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:17.579955 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-89ed1822-05e5-4d01-8aa1-3bca4b31bebc req-c54bd17f-f370-463d-841c-a1a9ea4397b4 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:17.591497 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-89ed1822-05e5-4d01-8aa1-3bca4b31bebc req-c54bd17f-f370-463d-841c-a1a9ea4397b4 service nova] Creating event network-vif-plugged:f3bd181a-3871-4d5f-91c2-895c1bf3aa93 for instance 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b on hv-cinder-84327 May 25 16:14:17.596392 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-89ed1822-05e5-4d01-8aa1-3bca4b31bebc req-c54bd17f-f370-463d-841c-a1a9ea4397b4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030125 May 25 16:14:17.596977 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 401/789] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:14:18.263580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3ed2114e-8888-47a0-959d-e00f97ed2ade tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:18.264382 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3ed2114e-8888-47a0-959d-e00f97ed2ade tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:18.272082 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3ed2114e-8888-47a0-959d-e00f97ed2ade tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:18.272567 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3ed2114e-8888-47a0-959d-e00f97ed2ade tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:18.273373 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3ed2114e-8888-47a0-959d-e00f97ed2ade tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:18.273815 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3ed2114e-8888-47a0-959d-e00f97ed2ade tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:18.407618 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3ed2114e-8888-47a0-959d-e00f97ed2ade tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:18.415577 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3ed2114e-8888-47a0-959d-e00f97ed2ade tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1314 microversion: 2.1 time: 0.156600 May 25 16:14:18.416185 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 389/790] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:18 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:18.966021 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-10f4c413-59fb-4766-9490-ac01599dc97f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:18.966825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-10f4c413-59fb-4766-9490-ac01599dc97f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:18.976279 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10f4c413-59fb-4766-9490-ac01599dc97f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:18.976912 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10f4c413-59fb-4766-9490-ac01599dc97f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:18.977991 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10f4c413-59fb-4766-9490-ac01599dc97f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:18.978417 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10f4c413-59fb-4766-9490-ac01599dc97f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:19.001173 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-10f4c413-59fb-4766-9490-ac01599dc97f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/ips" status: 200 len: 148 microversion: 2.1 time: 0.041992 May 25 16:14:19.001732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 402/791] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:14:18 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:19.432903 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e30f1f05-7065-481e-b029-0eee3bff2cf1 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:19.433686 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e30f1f05-7065-481e-b029-0eee3bff2cf1 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:19.440850 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e30f1f05-7065-481e-b029-0eee3bff2cf1 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:19.441523 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e30f1f05-7065-481e-b029-0eee3bff2cf1 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:19.442286 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e30f1f05-7065-481e-b029-0eee3bff2cf1 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:19.442949 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e30f1f05-7065-481e-b029-0eee3bff2cf1 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:19.580298 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e30f1f05-7065-481e-b029-0eee3bff2cf1 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:19.587947 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e30f1f05-7065-481e-b029-0eee3bff2cf1 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1499 microversion: 2.1 time: 0.159102 May 25 16:14:19.588560 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 390/792] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:19 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1499 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:20.055548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8de0f776-8e53-4968-97bd-6e1d45ba4bc4 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:20.056663 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8de0f776-8e53-4968-97bd-6e1d45ba4bc4 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:20.063520 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8de0f776-8e53-4968-97bd-6e1d45ba4bc4 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:20.063995 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8de0f776-8e53-4968-97bd-6e1d45ba4bc4 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:20.064765 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8de0f776-8e53-4968-97bd-6e1d45ba4bc4 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:20.065200 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8de0f776-8e53-4968-97bd-6e1d45ba4bc4 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:20.090409 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8de0f776-8e53-4968-97bd-6e1d45ba4bc4 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:14:20.145277 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:20.170446 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8de0f776-8e53-4968-97bd-6e1d45ba4bc4 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 204 len: 0 microversion: 2.1 time: 0.118198 May 25 16:14:20.171195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 403/793] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:14:20 2022] DELETE /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:14:20.180695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a1b3fb88-10b7-4007-b90b-ba13fe865a36 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:20.181317 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a1b3fb88-10b7-4007-b90b-ba13fe865a36 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:20.183163 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:20.183834 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:20.190087 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a1b3fb88-10b7-4007-b90b-ba13fe865a36 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:20.190535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a1b3fb88-10b7-4007-b90b-ba13fe865a36 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:20.191302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a1b3fb88-10b7-4007-b90b-ba13fe865a36 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:20.191737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a1b3fb88-10b7-4007-b90b-ba13fe865a36 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:20.322715 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a1b3fb88-10b7-4007-b90b-ba13fe865a36 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:20.330345 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a1b3fb88-10b7-4007-b90b-ba13fe865a36 tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1505 microversion: 2.1 time: 0.153708 May 25 16:14:20.330903 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 391/794] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:20 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:20.338213 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9ed9c313-de55-452e-bde0-f38a6dd64d7a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b394ee64-cbfd-4f91-822d-fd5f4348ae7f"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:20.339380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9ed9c313-de55-452e-bde0-f38a6dd64d7a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:20.345678 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ed9c313-de55-452e-bde0-f38a6dd64d7a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:20.346126 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ed9c313-de55-452e-bde0-f38a6dd64d7a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:20.346895 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ed9c313-de55-452e-bde0-f38a6dd64d7a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:20.347329 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ed9c313-de55-452e-bde0-f38a6dd64d7a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:21.348217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4722af45-c523-47d5-9a2a-881b7cc459fb tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:21.348897 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-4722af45-c523-47d5-9a2a-881b7cc459fb tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:21.355854 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4722af45-c523-47d5-9a2a-881b7cc459fb tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:21.356388 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4722af45-c523-47d5-9a2a-881b7cc459fb tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:21.357419 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4722af45-c523-47d5-9a2a-881b7cc459fb tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:21.357868 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-4722af45-c523-47d5-9a2a-881b7cc459fb tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:21.476955 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9ed9c313-de55-452e-bde0-f38a6dd64d7a tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "POST /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.142904 May 25 16:14:21.477735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 404/795] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:14:20 2022] POST /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments => generated 194 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:21.484222 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9b4bab09-7635-4e94-b720-6236681b82eb tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:21.485033 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9b4bab09-7635-4e94-b720-6236681b82eb tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:21.491797 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9b4bab09-7635-4e94-b720-6236681b82eb tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:21.492701 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9b4bab09-7635-4e94-b720-6236681b82eb tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:21.493185 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-4722af45-c523-47d5-9a2a-881b7cc459fb tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:21.493646 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9b4bab09-7635-4e94-b720-6236681b82eb tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:21.495524 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9b4bab09-7635-4e94-b720-6236681b82eb tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:21.501335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4722af45-c523-47d5-9a2a-881b7cc459fb tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1505 microversion: 2.1 time: 0.157900 May 25 16:14:21.502002 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 392/796] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:21 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:21.526006 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9b4bab09-7635-4e94-b720-6236681b82eb tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/ips" status: 200 len: 146 microversion: 2.1 time: 0.046738 May 25 16:14:21.526437 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 405/797] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:14:21 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:22.125332 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-180c6ae3-2f86-415f-bdde-2402cf99fc50 req-585f5ccf-f1ce-4dea-954b-b9fc7a7f2a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3b9edc-aaaf-4581-a1b0-5fcc7025373b", "name": "network-vif-deleted", "tag": "f3bd181a-3871-4d5f-91c2-895c1bf3aa93"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:22.135960 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-180c6ae3-2f86-415f-bdde-2402cf99fc50 req-585f5ccf-f1ce-4dea-954b-b9fc7a7f2a31 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:22.136425 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-180c6ae3-2f86-415f-bdde-2402cf99fc50 req-585f5ccf-f1ce-4dea-954b-b9fc7a7f2a31 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:22.148528 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-180c6ae3-2f86-415f-bdde-2402cf99fc50 req-585f5ccf-f1ce-4dea-954b-b9fc7a7f2a31 service nova] Creating event network-vif-deleted:f3bd181a-3871-4d5f-91c2-895c1bf3aa93 for instance 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b on hv-cinder-84327 May 25 16:14:22.155249 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-180c6ae3-2f86-415f-bdde-2402cf99fc50 req-585f5ccf-f1ce-4dea-954b-b9fc7a7f2a31 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033669 May 25 16:14:22.155870 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 393/798] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:22.523995 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:22.524798 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:22.531967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:22.532426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:22.533237 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:22.533669 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:22.566552 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:22.567045 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:22.567368 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lazy-loading 'fault' on Instance uuid 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:14:22.617341 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40052f39d8ad48f3ab5af37806ebfcb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234b2b74107748719889e8c695484040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:22.625091 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2b246c6a-eeaf-48e6-9543-505400a0a2bf tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 200 len: 1304 microversion: 2.1 time: 0.109066 May 25 16:14:22.625667 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 406/799] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:22 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:22.865487 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7ebc3867-558d-426b-9de2-df1db4abdd54 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1edc8595-8b76-498e-94b6-228dcd09de88"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:22.866633 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7ebc3867-558d-426b-9de2-df1db4abdd54 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:22.874104 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7ebc3867-558d-426b-9de2-df1db4abdd54 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:22.874518 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7ebc3867-558d-426b-9de2-df1db4abdd54 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:22.875362 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7ebc3867-558d-426b-9de2-df1db4abdd54 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:22.875802 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7ebc3867-558d-426b-9de2-df1db4abdd54 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:23.147178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7ebc3867-558d-426b-9de2-df1db4abdd54 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285954 May 25 16:14:23.147914 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 394/800] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:14:22 2022] POST /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:23.642640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:23.643363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] [instance: 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:23.650208 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:23.650801 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:23.651435 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:23.651876 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:23.667406 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] HTTP exception thrown: Instance 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b could not be found. May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Request method failure captured: May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b HTTP/1.1 May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlW3KXTau91_b2Zk9wl2C55xI8au9X6yfKdzHLg7j5tzlcvy4DBLgb3IoJd2DfqC1AmRyNIHmA0ZcGojrN_LUmJnyqj2A52avhdOZQgQnoSEQmhrRK9voUOM_wJxGA9fngJLRyHOJccMsHqv0ZoaEsg9np-70XaxTkShmabUeAxURYo May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 234b2b74107748719889e8c695484040 May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesActionsTest-1331229650 May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:14:23.669475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_234b2b74107748719889e8c695484040", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/234b2b74107748719889e8c695484040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/234b2b74107748719889e8c695484040"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/234b2b74107748719889e8c695484040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesActionsTest-1331229650 May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 234b2b74107748719889e8c695484040 May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesActionsTest-1331229650 May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesActionsTest-1331229650-project May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 40052f39d8ad48f3ab5af37806ebfcb3 May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesActionsTest-1331229650-project May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b could not be found. May 25 16:14:23.671179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '2f3b9edc-aaaf-4581-a1b0-5fcc7025373b'} May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b could not be found. May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:23.672097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b could not be found. May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b could not be found. May 25 16:14:23.673380 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:23.674531 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] Returning 404 to user: Instance 2f3b9edc-aaaf-4581-a1b0-5fcc7025373b could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:23.674531 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-496b2b18-2aa8-4d29-a6a8-84768e0152bc tempest-VolumesActionsTest-1331229650 tempest-VolumesActionsTest-1331229650-project] 10.222.0.85 "GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b" status: 404 len: 111 microversion: 2.1 time: 0.032268 May 25 16:14:23.674531 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 407/801] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:23 2022] GET /compute/v2.1/servers/2f3b9edc-aaaf-4581-a1b0-5fcc7025373b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:29.188036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f9ee99a9-d411-45d7-9ac7-6137eee78d54 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:29.188655 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f9ee99a9-d411-45d7-9ac7-6137eee78d54 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:29.195211 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f9ee99a9-d411-45d7-9ac7-6137eee78d54 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:29.195882 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f9ee99a9-d411-45d7-9ac7-6137eee78d54 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:29.196705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f9ee99a9-d411-45d7-9ac7-6137eee78d54 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:29.197137 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f9ee99a9-d411-45d7-9ac7-6137eee78d54 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:29.281719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-f9ee99a9-d411-45d7-9ac7-6137eee78d54 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lazy-loading 'services' on Instance uuid 0c190734-ecd1-4f6b-9773-15cc8410902b {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:14:29.358193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f9ee99a9-d411-45d7-9ac7-6137eee78d54 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments/b394ee64-cbfd-4f91-822d-fd5f4348ae7f" status: 202 len: 0 microversion: 2.1 time: 0.175247 May 25 16:14:29.358887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 395/802] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:14:29 2022] DELETE /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments/b394ee64-cbfd-4f91-822d-fd5f4348ae7f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:14:29.367514 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9ec6a8d4-2686-4c88-af6a-c5f2af0f67c4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:29.369267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9ec6a8d4-2686-4c88-af6a-c5f2af0f67c4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:29.376621 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ec6a8d4-2686-4c88-af6a-c5f2af0f67c4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:29.377175 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ec6a8d4-2686-4c88-af6a-c5f2af0f67c4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:29.377913 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ec6a8d4-2686-4c88-af6a-c5f2af0f67c4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:29.378357 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9ec6a8d4-2686-4c88-af6a-c5f2af0f67c4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:29.421745 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9ec6a8d4-2686-4c88-af6a-c5f2af0f67c4 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058233 May 25 16:14:29.427972 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 408/803] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:29 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:30.435368 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-62af8b4e-88a2-470e-924e-68c6a2e39991 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:30.437155 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-62af8b4e-88a2-470e-924e-68c6a2e39991 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:30.444467 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62af8b4e-88a2-470e-924e-68c6a2e39991 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:30.444916 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62af8b4e-88a2-470e-924e-68c6a2e39991 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:30.445678 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62af8b4e-88a2-470e-924e-68c6a2e39991 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:30.446278 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-62af8b4e-88a2-470e-924e-68c6a2e39991 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:30.478538 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-62af8b4e-88a2-470e-924e-68c6a2e39991 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048581 May 25 16:14:30.482343 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 396/804] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:30 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:31.493147 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1fa30b8c-e9f2-4bc3-bfda-c41bd6405e8f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:31.494185 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1fa30b8c-e9f2-4bc3-bfda-c41bd6405e8f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:31.502354 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1fa30b8c-e9f2-4bc3-bfda-c41bd6405e8f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:31.502798 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1fa30b8c-e9f2-4bc3-bfda-c41bd6405e8f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:31.503571 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1fa30b8c-e9f2-4bc3-bfda-c41bd6405e8f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:31.504030 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1fa30b8c-e9f2-4bc3-bfda-c41bd6405e8f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:31.535928 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1fa30b8c-e9f2-4bc3-bfda-c41bd6405e8f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049372 May 25 16:14:31.536436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 409/805] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:31 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:32.548031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9f645359-ad5e-470b-986c-259baca63866 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:32.549717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9f645359-ad5e-470b-986c-259baca63866 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:32.556813 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f645359-ad5e-470b-986c-259baca63866 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:32.557579 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f645359-ad5e-470b-986c-259baca63866 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:32.558576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f645359-ad5e-470b-986c-259baca63866 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:32.559206 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f645359-ad5e-470b-986c-259baca63866 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:32.611251 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9f645359-ad5e-470b-986c-259baca63866 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067184 May 25 16:14:32.612570 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 397/806] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:32 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:33.623803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8e6b96b3-cad1-4912-ae58-ca48cc9f4aae tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:33.627933 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8e6b96b3-cad1-4912-ae58-ca48cc9f4aae tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:33.635741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8e6b96b3-cad1-4912-ae58-ca48cc9f4aae tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:33.636199 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8e6b96b3-cad1-4912-ae58-ca48cc9f4aae tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:33.637209 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8e6b96b3-cad1-4912-ae58-ca48cc9f4aae tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:33.637833 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8e6b96b3-cad1-4912-ae58-ca48cc9f4aae tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:33.670439 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8e6b96b3-cad1-4912-ae58-ca48cc9f4aae tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050783 May 25 16:14:33.671298 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 410/807] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:33 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:34.682872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d533136e-2560-4613-8139-d13cde7988ee tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:34.684043 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d533136e-2560-4613-8139-d13cde7988ee tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:34.691295 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d533136e-2560-4613-8139-d13cde7988ee tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:34.691913 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d533136e-2560-4613-8139-d13cde7988ee tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:34.692834 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d533136e-2560-4613-8139-d13cde7988ee tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:34.693565 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d533136e-2560-4613-8139-d13cde7988ee tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:34.725912 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d533136e-2560-4613-8139-d13cde7988ee tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047311 May 25 16:14:34.727017 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 398/808] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:34 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:34.949889 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b31c6d4a-4c2b-479d-be1f-ffb249c00037 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:34.951079 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b31c6d4a-4c2b-479d-be1f-ffb249c00037 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:34.959337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b31c6d4a-4c2b-479d-be1f-ffb249c00037 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:34.960240 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b31c6d4a-4c2b-479d-be1f-ffb249c00037 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:34.961052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b31c6d4a-4c2b-479d-be1f-ffb249c00037 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:34.961627 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b31c6d4a-4c2b-479d-be1f-ffb249c00037 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:34.998945 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b31c6d4a-4c2b-479d-be1f-ffb249c00037 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053561 May 25 16:14:34.999808 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 411/809] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:34 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:35.010451 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-15ff5a49-73ba-4ca5-a3b5-2a51b35d6b1b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:35.011212 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-15ff5a49-73ba-4ca5-a3b5-2a51b35d6b1b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:35.018420 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15ff5a49-73ba-4ca5-a3b5-2a51b35d6b1b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:35.019227 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15ff5a49-73ba-4ca5-a3b5-2a51b35d6b1b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:35.020097 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15ff5a49-73ba-4ca5-a3b5-2a51b35d6b1b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:35.020550 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-15ff5a49-73ba-4ca5-a3b5-2a51b35d6b1b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:35.050806 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-15ff5a49-73ba-4ca5-a3b5-2a51b35d6b1b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/1edc8595-8b76-498e-94b6-228dcd09de88" status: 200 len: 194 microversion: 2.1 time: 0.044806 May 25 16:14:35.051409 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 399/810] 10.222.0.85 () {58 vars in 1412 bytes} [Wed May 25 16:14:35 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/1edc8595-8b76-498e-94b6-228dcd09de88 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:14:35.740259 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e760285c-8b25-4afc-b477-20c370c07d9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:35.741593 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e760285c-8b25-4afc-b477-20c370c07d9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:35.749992 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e760285c-8b25-4afc-b477-20c370c07d9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:35.750486 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e760285c-8b25-4afc-b477-20c370c07d9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:35.752139 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e760285c-8b25-4afc-b477-20c370c07d9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:35.752313 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e760285c-8b25-4afc-b477-20c370c07d9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:35.789349 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e760285c-8b25-4afc-b477-20c370c07d9f tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054771 May 25 16:14:35.790005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 412/811] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:35 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:14:35.854817 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fdd1b428-89c5-4ee1-8ce9-44fbf43e1a65 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:35.855399 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fdd1b428-89c5-4ee1-8ce9-44fbf43e1a65 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:35.863000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fdd1b428-89c5-4ee1-8ce9-44fbf43e1a65 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:35.863759 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fdd1b428-89c5-4ee1-8ce9-44fbf43e1a65 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:35.864713 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fdd1b428-89c5-4ee1-8ce9-44fbf43e1a65 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:35.865392 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fdd1b428-89c5-4ee1-8ce9-44fbf43e1a65 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:35.901957 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fdd1b428-89c5-4ee1-8ce9-44fbf43e1a65 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Going to try to terminate instance {{(pid=117763) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:14:35.983918 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:36.017814 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fdd1b428-89c5-4ee1-8ce9-44fbf43e1a65 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 204 len: 0 microversion: 2.1 time: 0.166882 May 25 16:14:36.021787 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 400/812] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:14:35 2022] DELETE /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:14:36.027576 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-abdc7b4f-c525-4063-8685-20d806fad89c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:36.028859 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-abdc7b4f-c525-4063-8685-20d806fad89c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:36.038160 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-abdc7b4f-c525-4063-8685-20d806fad89c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:36.038631 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-abdc7b4f-c525-4063-8685-20d806fad89c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:36.039384 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-abdc7b4f-c525-4063-8685-20d806fad89c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:36.040462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-abdc7b4f-c525-4063-8685-20d806fad89c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:36.182466 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-abdc7b4f-c525-4063-8685-20d806fad89c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:36.186667 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:36.192612 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-abdc7b4f-c525-4063-8685-20d806fad89c tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1679 microversion: 2.1 time: 0.169096 May 25 16:14:36.203978 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 413/813] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:36 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:14:36.456198 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d6a82425-4d94-4a8c-b2f4-37b208e5bd08 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "290c6431-75d2-46b4-9d8c-01ffafab00f2"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:36.457710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d6a82425-4d94-4a8c-b2f4-37b208e5bd08 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:36.464705 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d6a82425-4d94-4a8c-b2f4-37b208e5bd08 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:36.465433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d6a82425-4d94-4a8c-b2f4-37b208e5bd08 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:36.466659 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d6a82425-4d94-4a8c-b2f4-37b208e5bd08 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:36.467124 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d6a82425-4d94-4a8c-b2f4-37b208e5bd08 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:37.212199 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-28266380-c6ab-4c5c-92a5-499df88e16e3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:37.213010 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-28266380-c6ab-4c5c-92a5-499df88e16e3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:37.221001 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28266380-c6ab-4c5c-92a5-499df88e16e3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:37.221777 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28266380-c6ab-4c5c-92a5-499df88e16e3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:37.222868 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28266380-c6ab-4c5c-92a5-499df88e16e3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:37.223519 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-28266380-c6ab-4c5c-92a5-499df88e16e3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:37.399842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-28266380-c6ab-4c5c-92a5-499df88e16e3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:37.409614 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-28266380-c6ab-4c5c-92a5-499df88e16e3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1679 microversion: 2.1 time: 0.201568 May 25 16:14:37.410159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 414/814] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:37 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:14:37.758026 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d6a82425-4d94-4a8c-b2f4-37b208e5bd08 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "POST /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.307096 May 25 16:14:37.763230 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 401/815] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:14:36 2022] POST /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments => generated 194 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:38.430305 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b6f39ed7-d9ef-435f-98c2-e4661ac70af3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:38.432957 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b6f39ed7-d9ef-435f-98c2-e4661ac70af3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:38.445662 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b6f39ed7-d9ef-435f-98c2-e4661ac70af3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:38.446494 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b6f39ed7-d9ef-435f-98c2-e4661ac70af3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:38.448454 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b6f39ed7-d9ef-435f-98c2-e4661ac70af3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:38.449821 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b6f39ed7-d9ef-435f-98c2-e4661ac70af3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:38.738235 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b6f39ed7-d9ef-435f-98c2-e4661ac70af3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:38.748424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b6f39ed7-d9ef-435f-98c2-e4661ac70af3 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1679 microversion: 2.1 time: 0.325051 May 25 16:14:38.750238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 415/816] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:38 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1679 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:14:39.324220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-aba3e831-f528-46e2-91eb-e860085392fb req-3c1116a5-4fdf-4e86-9644-844ec048bb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c190734-ecd1-4f6b-9773-15cc8410902b", "name": "network-vif-deleted", "tag": "2023d7e0-2db9-47f7-9275-9c71e254f1b9"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:39.345866 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-aba3e831-f528-46e2-91eb-e860085392fb req-3c1116a5-4fdf-4e86-9644-844ec048bb49 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:39.346323 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-aba3e831-f528-46e2-91eb-e860085392fb req-3c1116a5-4fdf-4e86-9644-844ec048bb49 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:39.381404 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-aba3e831-f528-46e2-91eb-e860085392fb req-3c1116a5-4fdf-4e86-9644-844ec048bb49 service nova] Creating event network-vif-deleted:2023d7e0-2db9-47f7-9275-9c71e254f1b9 for instance 0c190734-ecd1-4f6b-9773-15cc8410902b on hv-cinder-84327 May 25 16:14:39.396858 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-aba3e831-f528-46e2-91eb-e860085392fb req-3c1116a5-4fdf-4e86-9644-844ec048bb49 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076986 May 25 16:14:39.400417 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 402/817] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:39.767118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:39.768405 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:39.781531 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:39.782391 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:39.783396 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:39.784006 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:39.853173 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:39.853722 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:39.854264 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lazy-loading 'fault' on Instance uuid 0c190734-ecd1-4f6b-9773-15cc8410902b {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:14:39.936434 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708fdc537e1747d7bd5917ed7af9c368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e48e8e884b4840ba54d546d82d2334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:39.946466 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-62665316-4500-4ee0-8c34-04fdca9aa761 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 200 len: 1330 microversion: 2.1 time: 0.182926 May 25 16:14:39.948098 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 416/818] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:39 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 1330 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:40.966294 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:40.967693 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:40.974281 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:40.974729 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:40.975695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:40.976342 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:40.990379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b HTTP/1.1 May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:14:40.992401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:40.994077 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '0c190734-ecd1-4f6b-9773-15cc8410902b'} May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:40.994998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:40.996609 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:40.998990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:40.999851 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e1c65b97-2f7b-4f5b-b842-c83c187aaf82 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 404 len: 111 microversion: 2.1 time: 0.038658 May 25 16:14:41.003639 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 403/819] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:40 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:41.012250 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1c2411d3-a59d-45de-b7e9-acc635e4ab29 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '.version_select at 0x7fbaf0249e50>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:41.033970 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1c2411d3-a59d-45de-b7e9-acc635e4ab29 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476279639" status: 202 len: 0 microversion: 2.1 time: 0.025799 May 25 16:14:41.034855 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 417/820] 10.222.0.85 () {58 vars in 1217 bytes} [Wed May 25 16:14:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476279639 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:14:43.140780 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:43.142162 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:43.149761 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:43.150959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:43.152254 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:43.152842 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:43.170592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: DELETE /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b HTTP/1.1 May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:14:43.173535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.175374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '0c190734-ecd1-4f6b-9773-15cc8410902b'} May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:43.176199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.177379 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:43.179834 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:43.181200 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-faea5c75-7103-4560-84d5-a5d2e5ade627 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 404 len: 111 microversion: 2.1 time: 0.044358 May 25 16:14:43.185461 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 404/821] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:14:43 2022] DELETE /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:43.190493 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:43.191339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 0c190734-ecd1-4f6b-9773-15cc8410902b] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:43.198995 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:43.199519 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:43.200401 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:43.201222 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:43.219921 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b HTTP/1.1 May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:14:43.221522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.223135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '0c190734-ecd1-4f6b-9773-15cc8410902b'} May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:43.223964 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. May 25 16:14:43.225136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:43.226195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance 0c190734-ecd1-4f6b-9773-15cc8410902b could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:43.226195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d3695028-0e06-411d-b5dd-5070bec572c5 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b" status: 404 len: 111 microversion: 2.1 time: 0.036543 May 25 16:14:43.226195 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 418/822] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:43 2022] GET /compute/v2.1/servers/0c190734-ecd1-4f6b-9773-15cc8410902b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 16:14:44.373553 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:44.374109 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:44.380891 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:44.381336 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:44.382095 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:44.382528 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:44.396603 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: DELETE /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 HTTP/1.1 May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:14:44.398165 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.399781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '45665f8b-ba12-41a5-8ba1-43b9dcd8e166'} May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:44.400718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.402174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.403581 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:44.403581 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7a2f4d18-f9b9-400d-9220-1ded5857ae06 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 404 len: 111 microversion: 2.1 time: 0.029955 May 25 16:14:44.403581 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 405/823] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:14:44 2022] DELETE /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:44.416474 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:44.417486 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 45665f8b-ba12-41a5-8ba1-43b9dcd8e166] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:44.425511 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:44.426077 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:44.427316 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:44.427433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:44.442727 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 HTTP/1.1 May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:14:44.444563 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.446052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '45665f8b-ba12-41a5-8ba1-43b9dcd8e166'} May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:44.446815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. May 25 16:14:44.448037 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.449603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance 45665f8b-ba12-41a5-8ba1-43b9dcd8e166 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:44.449603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0a1f73bc-008f-4dd8-85b1-ca67708bf22b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166" status: 404 len: 111 microversion: 2.1 time: 0.037089 May 25 16:14:44.449603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 419/824] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:44 2022] GET /compute/v2.1/servers/45665f8b-ba12-41a5-8ba1-43b9dcd8e166 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:44.455218 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:44.455703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:44.462377 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:44.462858 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:44.463875 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:44.464339 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:44.480268 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: DELETE /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb HTTP/1.1 May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:14:44.481839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.483216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '53b50f41-74ab-479c-898d-14e7396de0bb'} May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:44.484397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.485887 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:44.487446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:44.487446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ad4ffb12-4a83-429d-b7e5-1c7663f4c306 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 404 len: 111 microversion: 2.1 time: 0.032102 May 25 16:14:44.487446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 406/825] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:14:44 2022] DELETE /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:44.493933 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:44.494574 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: 53b50f41-74ab-479c-898d-14e7396de0bb] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:44.502957 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:44.503413 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:44.504225 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:44.504815 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:44.521915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb HTTP/1.1 May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:14:44.523778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.525253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '53b50f41-74ab-479c-898d-14e7396de0bb'} May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:44.526029 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. May 25 16:14:44.528544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:44.530256 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance 53b50f41-74ab-479c-898d-14e7396de0bb could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:44.530256 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c7d686b9-e0a7-4d53-ae33-853df9a8d69b tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb" status: 404 len: 111 microversion: 2.1 time: 0.036556 May 25 16:14:44.530256 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 420/826] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:44 2022] GET /compute/v2.1/servers/53b50f41-74ab-479c-898d-14e7396de0bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:45.393625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7b909afd-00d5-414d-b5b8-8f54c9f07fdf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:45.394553 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7b909afd-00d5-414d-b5b8-8f54c9f07fdf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:45.401220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7b909afd-00d5-414d-b5b8-8f54c9f07fdf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.401660 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7b909afd-00d5-414d-b5b8-8f54c9f07fdf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.402390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7b909afd-00d5-414d-b5b8-8f54c9f07fdf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.402822 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7b909afd-00d5-414d-b5b8-8f54c9f07fdf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.432670 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7b909afd-00d5-414d-b5b8-8f54c9f07fdf tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043055 May 25 16:14:45.433211 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 407/827] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:45 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:45.585120 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-37a87c5f-4dab-44cb-99be-11046a426e58 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:45.585907 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-37a87c5f-4dab-44cb-99be-11046a426e58 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:45.593856 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-37a87c5f-4dab-44cb-99be-11046a426e58 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.594314 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-37a87c5f-4dab-44cb-99be-11046a426e58 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.595097 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-37a87c5f-4dab-44cb-99be-11046a426e58 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.595533 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-37a87c5f-4dab-44cb-99be-11046a426e58 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.625182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-37a87c5f-4dab-44cb-99be-11046a426e58 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/1edc8595-8b76-498e-94b6-228dcd09de88" status: 200 len: 194 microversion: 2.1 time: 0.046812 May 25 16:14:45.625959 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 421/828] 10.222.0.85 () {58 vars in 1412 bytes} [Wed May 25 16:14:45 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/1edc8595-8b76-498e-94b6-228dcd09de88 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:45.636294 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-63dde777-014d-4cde-a0b8-6cf0ccba559f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:45.636793 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-63dde777-014d-4cde-a0b8-6cf0ccba559f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:45.643153 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-63dde777-014d-4cde-a0b8-6cf0ccba559f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.643606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-63dde777-014d-4cde-a0b8-6cf0ccba559f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.644405 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-63dde777-014d-4cde-a0b8-6cf0ccba559f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.644876 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-63dde777-014d-4cde-a0b8-6cf0ccba559f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.675156 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:45.675662 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:45.681811 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.682356 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.683853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.684769 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.700587 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: DELETE /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a HTTP/1.1 May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:14:45.702569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.705325 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'fb52261b-f0d9-4cfc-a5df-dc306324060a'} May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:45.706424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.708068 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.709348 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:45.710289 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-599c9b53-455e-481d-81c7-f1d754ef7d96 tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "DELETE /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 404 len: 111 microversion: 2.1 time: 0.039104 May 25 16:14:45.714186 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 422/829] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:14:45 2022] DELETE /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 16:14:45.720052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:45.720671 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] [instance: fb52261b-f0d9-4cfc-a5df-dc306324060a] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:45.727881 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.728885 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.729673 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:45.730114 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:45.736016 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-63dde777-014d-4cde-a0b8-6cf0ccba559f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lazy-loading 'services' on Instance uuid 82d82389-e0ca-4a82-98ae-47c6eac2a000 {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:14:45.746239 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] HTTP exception thrown: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Request method failure captured: May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a HTTP/1.1 May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRnCzRoyQfz58qtl0fq11X7svOfuJqwZoWKN1j58Ae6B6-GBpHZgNJaOX47gjHhwocUU6iNYJ1X5xFsxx5NJMjQPvt-azlZqaG1YutlmZbb1V60iDGIjizhEuDvrAfhj-Cxc7yjt8V5nvZEReeMWz_h_2-xcLNbbrGURtMK2onj5ok May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:14:45.748087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_32e48e8e884b4840ba54d546d82d2334", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/32e48e8e884b4840ba54d546d82d2334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 32e48e8e884b4840ba54d546d82d2334 May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-699019392 May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 708fdc537e1747d7bd5917ed7af9c368 May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeNegativeTest-699019392-project May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.749685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'fb52261b-f0d9-4cfc-a5df-dc306324060a'} May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:45.750561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. May 25 16:14:45.751741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:45.752862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] Returning 404 to user: Instance fb52261b-f0d9-4cfc-a5df-dc306324060a could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:45.752862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-07968f9d-f552-4210-8640-c6c4454023cd tempest-AttachVolumeNegativeTest-699019392 tempest-AttachVolumeNegativeTest-699019392-project] 10.222.0.85 "GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a" status: 404 len: 111 microversion: 2.1 time: 0.034565 May 25 16:14:45.752862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 423/830] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:45 2022] GET /compute/v2.1/servers/fb52261b-f0d9-4cfc-a5df-dc306324060a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:45.827732 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-63dde777-014d-4cde-a0b8-6cf0ccba559f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/1edc8595-8b76-498e-94b6-228dcd09de88" status: 202 len: 0 microversion: 2.1 time: 0.195396 May 25 16:14:45.828916 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 408/831] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:14:45 2022] DELETE /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/1edc8595-8b76-498e-94b6-228dcd09de88 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:14:46.973773 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-dc0c77cd-a110-401e-a031-d4a47e9678da tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:46.974287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-dc0c77cd-a110-401e-a031-d4a47e9678da tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:46.979626 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:46.981677 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dc0c77cd-a110-401e-a031-d4a47e9678da tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:46.982178 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dc0c77cd-a110-401e-a031-d4a47e9678da tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:46.983126 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dc0c77cd-a110-401e-a031-d4a47e9678da tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:46.983566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-dc0c77cd-a110-401e-a031-d4a47e9678da tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:47.017689 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-dc0c77cd-a110-401e-a031-d4a47e9678da tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/290c6431-75d2-46b4-9d8c-01ffafab00f2" status: 200 len: 194 microversion: 2.1 time: 0.047883 May 25 16:14:47.018614 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 424/832] 10.222.0.85 () {58 vars in 1412 bytes} [Wed May 25 16:14:46 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/290c6431-75d2-46b4-9d8c-01ffafab00f2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:47.029751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d9800274-10d0-443b-a967-1344bdda941a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:47.031298 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d9800274-10d0-443b-a967-1344bdda941a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:47.039607 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d9800274-10d0-443b-a967-1344bdda941a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:47.040088 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d9800274-10d0-443b-a967-1344bdda941a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:47.040890 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d9800274-10d0-443b-a967-1344bdda941a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:47.041321 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d9800274-10d0-443b-a967-1344bdda941a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:47.143501 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-d9800274-10d0-443b-a967-1344bdda941a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lazy-loading 'services' on Instance uuid 82d82389-e0ca-4a82-98ae-47c6eac2a000 {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:14:47.223146 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d9800274-10d0-443b-a967-1344bdda941a tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/290c6431-75d2-46b4-9d8c-01ffafab00f2" status: 202 len: 0 microversion: 2.1 time: 0.198391 May 25 16:14:47.227190 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 409/833] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:14:47 2022] DELETE /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments/290c6431-75d2-46b4-9d8c-01ffafab00f2 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:14:48.442910 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-99b5a507-329e-45de-bfc3-8f3c49c227ad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:48.444451 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-99b5a507-329e-45de-bfc3-8f3c49c227ad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:48.451916 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-99b5a507-329e-45de-bfc3-8f3c49c227ad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:48.452362 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-99b5a507-329e-45de-bfc3-8f3c49c227ad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:48.453510 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-99b5a507-329e-45de-bfc3-8f3c49c227ad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:48.454778 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-99b5a507-329e-45de-bfc3-8f3c49c227ad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:48.490348 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-99b5a507-329e-45de-bfc3-8f3c49c227ad tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051748 May 25 16:14:48.497045 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 425/834] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:48 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:14:48.609814 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-cf809b79-ec0b-45dc-8ae5-82fecad8820d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:48.611708 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-cf809b79-ec0b-45dc-8ae5-82fecad8820d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:48.614044 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:48.620022 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cf809b79-ec0b-45dc-8ae5-82fecad8820d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:48.620907 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cf809b79-ec0b-45dc-8ae5-82fecad8820d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:48.621866 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cf809b79-ec0b-45dc-8ae5-82fecad8820d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:48.622599 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cf809b79-ec0b-45dc-8ae5-82fecad8820d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:48.665224 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-cf809b79-ec0b-45dc-8ae5-82fecad8820d tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060325 May 25 16:14:48.671734 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 410/835] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:14:48 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:14:48.759169 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-29914008-d195-4739-b36b-643d81db6f95 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:48.759718 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-29914008-d195-4739-b36b-643d81db6f95 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:48.766031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29914008-d195-4739-b36b-643d81db6f95 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:48.766979 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29914008-d195-4739-b36b-643d81db6f95 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:48.767949 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29914008-d195-4739-b36b-643d81db6f95 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:48.768536 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29914008-d195-4739-b36b-643d81db6f95 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:48.805681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-29914008-d195-4739-b36b-643d81db6f95 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:14:48.914191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-29914008-d195-4739-b36b-643d81db6f95 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 204 len: 0 microversion: 2.1 time: 0.158721 May 25 16:14:48.915353 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 426/836] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:14:48 2022] DELETE /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:14:48.925082 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5a301bdc-5bd7-413c-9c38-da8fc645529f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:48.926745 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5a301bdc-5bd7-413c-9c38-da8fc645529f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:48.937220 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5a301bdc-5bd7-413c-9c38-da8fc645529f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:48.938033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5a301bdc-5bd7-413c-9c38-da8fc645529f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:48.939053 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5a301bdc-5bd7-413c-9c38-da8fc645529f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:48.939706 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5a301bdc-5bd7-413c-9c38-da8fc645529f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:49.578231 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5a301bdc-5bd7-413c-9c38-da8fc645529f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:49.585721 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5a301bdc-5bd7-413c-9c38-da8fc645529f tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1674 microversion: 2.1 time: 0.664912 May 25 16:14:49.586291 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 411/837] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:48 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1674 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:50.605897 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e5e40fb2-c9ab-4d5c-be1c-f4b69526ac2b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:50.609451 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e5e40fb2-c9ab-4d5c-be1c-f4b69526ac2b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:50.616860 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5e40fb2-c9ab-4d5c-be1c-f4b69526ac2b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:50.617310 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5e40fb2-c9ab-4d5c-be1c-f4b69526ac2b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:50.618354 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5e40fb2-c9ab-4d5c-be1c-f4b69526ac2b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:50.619013 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5e40fb2-c9ab-4d5c-be1c-f4b69526ac2b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:50.794990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e5e40fb2-c9ab-4d5c-be1c-f4b69526ac2b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:50.803506 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e5e40fb2-c9ab-4d5c-be1c-f4b69526ac2b tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1674 microversion: 2.1 time: 0.203986 May 25 16:14:50.804687 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 427/838] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:50 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:51.820590 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-2d76937c-974c-4f2c-b99b-a67d61541209 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:51.823731 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-2d76937c-974c-4f2c-b99b-a67d61541209 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:51.848004 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d76937c-974c-4f2c-b99b-a67d61541209 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:51.848598 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d76937c-974c-4f2c-b99b-a67d61541209 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:51.849459 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d76937c-974c-4f2c-b99b-a67d61541209 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:51.849911 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-2d76937c-974c-4f2c-b99b-a67d61541209 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:51.936301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-b323d541-806c-46f2-8015-6bbe1db76a1a req-54f388a3-445c-4315-ae42-e527b952a428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d82389-e0ca-4a82-98ae-47c6eac2a000", "name": "network-vif-deleted", "tag": "1ba0185d-8af8-486d-89b0-0ed2b1f893a5"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:51.982707 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-b323d541-806c-46f2-8015-6bbe1db76a1a req-54f388a3-445c-4315-ae42-e527b952a428 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:52.001324 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-b323d541-806c-46f2-8015-6bbe1db76a1a req-54f388a3-445c-4315-ae42-e527b952a428 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:52.054086 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-b323d541-806c-46f2-8015-6bbe1db76a1a req-54f388a3-445c-4315-ae42-e527b952a428 service nova] Creating event network-vif-deleted:1ba0185d-8af8-486d-89b0-0ed2b1f893a5 for instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 on hv-cinder-84327 May 25 16:14:52.073117 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-b323d541-806c-46f2-8015-6bbe1db76a1a req-54f388a3-445c-4315-ae42-e527b952a428 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140773 May 25 16:14:52.076031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 428/839] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:14:52.158614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-2d76937c-974c-4f2c-b99b-a67d61541209 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0289402c6f245839a86b7b66714a8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93946fd1575e45428d2388015d64628f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:52.169820 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-2d76937c-974c-4f2c-b99b-a67d61541209 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 200 len: 1606 microversion: 2.1 time: 0.353200 May 25 16:14:52.173357 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 412/840] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:51 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 1606 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:53.012780 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1b7d3173-e1cb-4bbf-b081-f81d578550c0 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbae3f7c670>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:53.072278 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1b7d3173-e1cb-4bbf-b081-f81d578550c0 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/9f7dedbc-4d14-46cf-ad92-c50f6a24189a" status: 200 len: 351 microversion: 2.1 time: 0.064328 May 25 16:14:53.072879 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 429/841] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:14:53 2022] GET /compute/v2.1/os-volumes/9f7dedbc-4d14-46cf-ad92-c50f6a24189a => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:53.190867 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:53.195373 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:53.209364 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:53.209817 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:53.210737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:53.211307 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:53.232245 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] HTTP exception thrown: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Request method failure captured: May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 HTTP/1.1 May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRofSYuvVcCS4JFWumS-5BTEj9IoXM6iRbeKNhZFXxA-ufcTsUWjU4Cu1OtPIe7cK_Azge968DUIIOsuBJD25sXuBG81wYHdKRY1YqE3wnxOr48KWgpt9l8EujzZf1P7sl1irT8GNN9KA86JTgkAggMSgJg9Zh3sMkrhOffnxUjIqM May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:14:53.234075 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93946fd1575e45428d2388015d64628f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93946fd1575e45428d2388015d64628f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: a0289402c6f245839a86b7b66714a8f6 May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:53.235712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '82d82389-e0ca-4a82-98ae-47c6eac2a000'} May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:53.236668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:53.238136 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:53.239550 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Returning 404 to user: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:53.239894 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5e8e5f1e-1e17-4696-b403-3c9e011de712 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 404 len: 111 microversion: 2.1 time: 0.050964 May 25 16:14:53.240995 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 413/842] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:53 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:53.249615 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5ee7b17d-0d4a-4130-a7be-1a0696646c69 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '.version_select at 0x7fbae3e8fca0>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:53.282018 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5ee7b17d-0d4a-4130-a7be-1a0696646c69 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241319946" status: 202 len: 0 microversion: 2.1 time: 0.036313 May 25 16:14:53.282684 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 430/843] 10.222.0.85 () {58 vars in 1220 bytes} [Wed May 25 16:14:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241319946 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:14:54.621466 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0c5dcde8-d66f-4a48-b76b-a5cc8c94f64f tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbaf00bd3a0>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:54.688363 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0c5dcde8-d66f-4a48-b76b-a5cc8c94f64f tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/79b4ac4b-cdf4-4ecf-a299-a84dd8dbdd57" status: 200 len: 351 microversion: 2.1 time: 0.071666 May 25 16:14:54.689401 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 414/844] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:14:54 2022] GET /compute/v2.1/os-volumes/79b4ac4b-cdf4-4ecf-a299-a84dd8dbdd57 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:56.132498 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f1e5e757-ef4b-4c99-8a15-fc3224327c33 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbae3dd3550>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:56.219058 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f1e5e757-ef4b-4c99-8a15-fc3224327c33 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/52541a11-3062-45b4-acba-036e2cc78550" status: 200 len: 350 microversion: 2.1 time: 0.092642 May 25 16:14:56.219620 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 431/845] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:14:56 2022] GET /compute/v2.1/os-volumes/52541a11-3062-45b4-acba-036e2cc78550 => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:56.232719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ebb50dc5-99b2-4829-ae69-d8c31ca250b7 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbaf0bf5310>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:56.363652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d4ecb88d-0a2b-477f-a17b-5179c7deb115 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:56.365256 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d4ecb88d-0a2b-477f-a17b-5179c7deb115 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:56.372456 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d4ecb88d-0a2b-477f-a17b-5179c7deb115 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:56.373165 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d4ecb88d-0a2b-477f-a17b-5179c7deb115 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:56.374104 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d4ecb88d-0a2b-477f-a17b-5179c7deb115 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:56.376393 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d4ecb88d-0a2b-477f-a17b-5179c7deb115 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:56.417240 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ebb50dc5-99b2-4829-ae69-d8c31ca250b7 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.189734 May 25 16:14:56.417936 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 415/846] 10.222.0.85 () {58 vars in 1133 bytes} [Wed May 25 16:14:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:56.432566 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-21249c60-481e-485f-b1fe-3418dd6a459e tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbaf00bd8b0>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:56.438962 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d4ecb88d-0a2b-477f-a17b-5179c7deb115 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079623 May 25 16:14:56.440378 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 432/847] 10.222.0.85 () {60 vars in 1342 bytes} [Wed May 25 16:14:56 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:14:56.566590 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ecd699d2-efe8-4649-8800-cddbb8055608 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:56.567438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ecd699d2-efe8-4649-8800-cddbb8055608 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:56.585794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ecd699d2-efe8-4649-8800-cddbb8055608 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:56.587708 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ecd699d2-efe8-4649-8800-cddbb8055608 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:56.590900 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ecd699d2-efe8-4649-8800-cddbb8055608 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:56.593153 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ecd699d2-efe8-4649-8800-cddbb8055608 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:56.648923 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ecd699d2-efe8-4649-8800-cddbb8055608 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:14:56.650095 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-21249c60-481e-485f-b1fe-3418dd6a459e tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.221411 May 25 16:14:56.657455 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 416/848] 10.222.0.85 () {58 vars in 1148 bytes} [Wed May 25 16:14:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:14:56.664634 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-293602e9-dd35-4573-b6c3-526cac9d0c9a tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbaf0bf5670>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:56.792978 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-293602e9-dd35-4573-b6c3-526cac9d0c9a tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.133018 May 25 16:14:56.795613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 417/849] 10.222.0.85 () {58 vars in 1133 bytes} [Wed May 25 16:14:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:56.808001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:56.809936 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:56.821539 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ecd699d2-efe8-4649-8800-cddbb8055608 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 204 len: 0 microversion: 2.20 time: 0.257261 May 25 16:14:56.825223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 433/850] 10.222.0.85 () {60 vars in 1279 bytes} [Wed May 25 16:14:56 2022] DELETE /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 16:14:56.836287 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:56.836735 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:56.840362 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:56.840522 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4d34ee7a-89a1-4380-bceb-61c8789a738d tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbae3e5bb80>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:56.842210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:56.870280 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] HTTP exception thrown: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Request method failure captured: May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: DELETE /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 HTTP/1.1 May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRofSYuvVcCS4JFWumS-5BTEj9IoXM6iRbeKNhZFXxA-ufcTsUWjU4Cu1OtPIe7cK_Azge968DUIIOsuBJD25sXuBG81wYHdKRY1YqE3wnxOr48KWgpt9l8EujzZf1P7sl1irT8GNN9KA86JTgkAggMSgJg9Zh3sMkrhOffnxUjIqM May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:14:56.871985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93946fd1575e45428d2388015d64628f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93946fd1575e45428d2388015d64628f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: a0289402c6f245839a86b7b66714a8f6 May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:56.873588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '82d82389-e0ca-4a82-98ae-47c6eac2a000'} May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:56.874452 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:56.876193 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:56.877684 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Returning 404 to user: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:56.878196 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0e3502a5-aba5-4657-be69-fd8de991cdf7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 404 len: 111 microversion: 2.1 time: 0.075005 May 25 16:14:56.878861 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 418/851] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:14:56 2022] DELETE /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:56.885931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:56.886852 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:56.893922 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:56.894520 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:56.895528 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:56.896200 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:57.029611 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4d34ee7a-89a1-4380-bceb-61c8789a738d tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.202640 May 25 16:14:57.030779 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 434/852] 10.222.0.85 () {58 vars in 1166 bytes} [Wed May 25 16:14:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:57.038258 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:57.039302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 82d82389-e0ca-4a82-98ae-47c6eac2a000] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:57.053495 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:57.054196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:57.058435 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:57.059438 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:57.090612 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:57.094910 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] HTTP exception thrown: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Request method failure captured: May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 HTTP/1.1 May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRofSYuvVcCS4JFWumS-5BTEj9IoXM6iRbeKNhZFXxA-ufcTsUWjU4Cu1OtPIe7cK_Azge968DUIIOsuBJD25sXuBG81wYHdKRY1YqE3wnxOr48KWgpt9l8EujzZf1P7sl1irT8GNN9KA86JTgkAggMSgJg9Zh3sMkrhOffnxUjIqM May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:14:57.096837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93946fd1575e45428d2388015d64628f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93946fd1575e45428d2388015d64628f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: a0289402c6f245839a86b7b66714a8f6 May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:57.098287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '82d82389-e0ca-4a82-98ae-47c6eac2a000'} May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:57.099009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. May 25 16:14:57.100415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:14:57.104419 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Returning 404 to user: Instance 82d82389-e0ca-4a82-98ae-47c6eac2a000 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:57.106325 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:57.107943 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-000dc91a-8c89-4740-b1cc-c44526ea17ea tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000" status: 404 len: 111 microversion: 2.1 time: 0.075190 May 25 16:14:57.108536 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 435/853] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:57 2022] GET /compute/v2.1/servers/82d82389-e0ca-4a82-98ae-47c6eac2a000 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:57.109884 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:57.111149 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7b8d97cf-d19d-428a-b26b-8be93b098536 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.230927 May 25 16:14:57.119925 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 419/854] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:56 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:57.120673 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-158d707e-4c6b-4596-9d90-035b85dfd851 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbae3f7c160>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:57.332575 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-158d707e-4c6b-4596-9d90-035b85dfd851 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.218998 May 25 16:14:57.340660 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 436/855] 10.222.0.85 () {58 vars in 1169 bytes} [Wed May 25 16:14:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:57.347465 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3cdd1c45-0e00-4263-9785-26182522b1f9 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbaf0060670>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:57.464438 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3cdd1c45-0e00-4263-9785-26182522b1f9 tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.122460 May 25 16:14:57.465023 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 420/856] 10.222.0.85 () {58 vars in 1154 bytes} [Wed May 25 16:14:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:57.477226 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-21af41a5-f8f4-47ad-b373-f73c895441ef tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbae3e6dee0>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:57.586298 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-21af41a5-f8f4-47ad-b373-f73c895441ef tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.112783 May 25 16:14:57.587630 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 437/857] 10.222.0.85 () {58 vars in 1187 bytes} [Wed May 25 16:14:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:14:57.601970 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b1fcb543-2732-4bf7-a418-3980a5a2d79d tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] Calling method '.version_select at 0x7fbaf00aa670>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:57.718047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b1fcb543-2732-4bf7-a418-3980a5a2d79d tempest-VolumesTestJSON-692193083 tempest-VolumesTestJSON-692193083-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.122170 May 25 16:14:57.719921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 421/858] 10.222.0.85 () {58 vars in 1154 bytes} [Wed May 25 16:14:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:14:58.134466 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:58.135092 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:58.142288 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:58.144114 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:58.145182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:58.146843 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:58.185232 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:14:58.329110 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:58.329616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:58.343049 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:58.343508 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:58.345557 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:58.346005 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:58.374062 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] HTTP exception thrown: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Request method failure captured: May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: DELETE /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 HTTP/1.1 May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRofSYuvVcCS4JFWumS-5BTEj9IoXM6iRbeKNhZFXxA-ufcTsUWjU4Cu1OtPIe7cK_Azge968DUIIOsuBJD25sXuBG81wYHdKRY1YqE3wnxOr48KWgpt9l8EujzZf1P7sl1irT8GNN9KA86JTgkAggMSgJg9Zh3sMkrhOffnxUjIqM May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:14:58.375654 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93946fd1575e45428d2388015d64628f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93946fd1575e45428d2388015d64628f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: a0289402c6f245839a86b7b66714a8f6 May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.377019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '6c5f2914-854d-4d77-82e5-680200d4d6c8'} May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:58.377775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.379006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.380613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Returning 404 to user: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:58.380613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8053a066-efe7-4e8a-a0fe-559abcfef726 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 404 len: 111 microversion: 2.1 time: 0.053003 May 25 16:14:58.380613 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 422/859] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:14:58 2022] DELETE /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 16:14:58.386862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:58.387492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] [instance: 6c5f2914-854d-4d77-82e5-680200d4d6c8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:58.401262 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:58.401716 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:58.402517 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:58.402958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:58.424163 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] HTTP exception thrown: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Request method failure captured: May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 HTTP/1.1 May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRofSYuvVcCS4JFWumS-5BTEj9IoXM6iRbeKNhZFXxA-ufcTsUWjU4Cu1OtPIe7cK_Azge968DUIIOsuBJD25sXuBG81wYHdKRY1YqE3wnxOr48KWgpt9l8EujzZf1P7sl1irT8GNN9KA86JTgkAggMSgJg9Zh3sMkrhOffnxUjIqM May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:14:58.425736 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_93946fd1575e45428d2388015d64628f", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/93946fd1575e45428d2388015d64628f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/93946fd1575e45428d2388015d64628f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 93946fd1575e45428d2388015d64628f May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeTestJSON-508094849 May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: a0289402c6f245839a86b7b66714a8f6 May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeTestJSON-508094849-project May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.427058 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '6c5f2914-854d-4d77-82e5-680200d4d6c8'} May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:14:58.427795 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. May 25 16:14:58.429047 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:14:58.430120 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] Returning 404 to user: Instance 6c5f2914-854d-4d77-82e5-680200d4d6c8 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:14:58.430120 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-991b899b-d7dd-4fa6-bc77-32828b73b8e7 tempest-AttachVolumeTestJSON-508094849 tempest-AttachVolumeTestJSON-508094849-project] 10.222.0.85 "GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8" status: 404 len: 111 microversion: 2.1 time: 0.044327 May 25 16:14:58.430120 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 423/860] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:14:58 2022] GET /compute/v2.1/servers/6c5f2914-854d-4d77-82e5-680200d4d6c8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:14:58.447266 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:58.455736 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:58.457261 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:58.458457 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-27a33047-4726-46c9-990a-bbafdcda8885 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1725 microversion: 2.20 time: 0.329200 May 25 16:14:58.459017 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 438/861] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:58 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1725 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:14:59.478513 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:14:59.479118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:14:59.488673 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:59.489138 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:59.492167 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:59.492649 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:59.598366 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-d800fe9c-cfe9-43e6-9c5f-c718525ef1e5 req-4ec9b5c3-f4c9-4aed-b180-34148b6c8b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3262238-f19e-4c85-b637-99459fd0e59c", "name": "network-vif-deleted", "tag": "1800f2a7-7112-4dbc-b1d8-94b717a81abe"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:14:59.610290 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-d800fe9c-cfe9-43e6-9c5f-c718525ef1e5 req-4ec9b5c3-f4c9-4aed-b180-34148b6c8b8b service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:14:59.611140 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-d800fe9c-cfe9-43e6-9c5f-c718525ef1e5 req-4ec9b5c3-f4c9-4aed-b180-34148b6c8b8b service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:14:59.660043 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-d800fe9c-cfe9-43e6-9c5f-c718525ef1e5 req-4ec9b5c3-f4c9-4aed-b180-34148b6c8b8b service nova] Creating event network-vif-deleted:1800f2a7-7112-4dbc-b1d8-94b717a81abe for instance a3262238-f19e-4c85-b637-99459fd0e59c on hv-cinder-84327 May 25 16:14:59.667853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-d800fe9c-cfe9-43e6-9c5f-c718525ef1e5 req-4ec9b5c3-f4c9-4aed-b180-34148b6c8b8b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073107 May 25 16:14:59.671755 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 439/862] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:14:59.719152 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:59.740199 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:59.745318 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be5c51fdd2fe4159a83a560dc074da6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4d81e1722439591065849449aeb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:14:59.747527 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-58c30ebd-2bde-44d0-ba81-539402b9100d tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 200 len: 1657 microversion: 2.20 time: 0.272866 May 25 16:14:59.750249 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 424/863] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:14:59 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 1657 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 16:15:00.768394 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:00.769031 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:00.781653 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:00.782106 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:00.782944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:00.783398 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:00.799340 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] HTTP exception thrown: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Request method failure captured: May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c HTTP/1.1 May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRfE43-QDxEc85RsAinp1XSohF8nDAtmkYOSPKPYoqGHL2-QM2vUfeqxBmNzpnVtvlRdrJ8XZ-ryQt470EEASTj6gWZgx5UhVaBrNXp9Xo__Px6AsRj8cn8zPbhEcSIyw5IZYNIOAm3nMyHF8hM671merzr857Vwp7QSbwxKSGxog8 May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:15:00.802984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_feb4d81e1722439591065849449aeb18", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/feb4d81e1722439591065849449aeb18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: be5c51fdd2fe4159a83a560dc074da6b May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:00.804492 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': 'a3262238-f19e-4c85-b637-99459fd0e59c'} May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:00.805447 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:00.806688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:00.810123 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Returning 404 to user: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:00.814870 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1fd07224-8498-4f7e-9d7b-29be557ad64e tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 404 len: 111 microversion: 2.20 time: 0.046988 May 25 16:15:00.818608 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 425/864] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:15:00 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 16:15:00.828275 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9d84f876-5658-42f1-848a-1df04df79f35 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '.version_select at 0x7fbaf004ee50>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:00.865012 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9d84f876-5658-42f1-848a-1df04df79f35 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421513543" status: 204 len: 0 microversion: 2.20 time: 0.044260 May 25 16:15:00.865603 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 426/865] 10.222.0.85 () {60 vars in 1261 bytes} [Wed May 25 16:15:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421513543 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 25 16:15:00.889564 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-fb675252-2fa8-4f4d-a304-ea583912d3ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Action: 'create', calling method: .version_select at 0x7fbae3f5c280>, body: {"keypair": {"name": "tempest-TestShelveInstance-837019089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFR8rF6t4j6S9VyBpVwDUhuUXZh9knguzG+Bp/4OM5FS7/t+xUgOgln42r5nBrt8yHNSTDX1TvHR3b1B1y7N7tr+fYMgUaSiOG2jcGE5HDGYqGFBQmwDHjkQqDPrFpDqTg=="}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:15:00.919885 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-fb675252-2fa8-4f4d-a304-ea583912d3ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Getting quotas for project 7528adefacfc41c5a54869ec5603bde8. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:15:00.929623 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-fb675252-2fa8-4f4d-a304-ea583912d3ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Getting quotas for user abd62b4b16da4dcd8e0bdbcb6d9db3a8 and project 7528adefacfc41c5a54869ec5603bde8. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:15:00.981864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-fb675252-2fa8-4f4d-a304-ea583912d3ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.385358 May 25 16:15:00.987999 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 440/866] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:15:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:15:03.749819 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:03.751292 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:03.767253 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:03.767992 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:03.768972 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:03.769639 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:03.809310 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] HTTP exception thrown: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Request method failure captured: May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: DELETE /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c HTTP/1.1 May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRfE43-QDxEc85RsAinp1XSohF8nDAtmkYOSPKPYoqGHL2-QM2vUfeqxBmNzpnVtvlRdrJ8XZ-ryQt470EEASTj6gWZgx5UhVaBrNXp9Xo__Px6AsRj8cn8zPbhEcSIyw5IZYNIOAm3nMyHF8hM671merzr857Vwp7QSbwxKSGxog8 May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:15:03.811178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_feb4d81e1722439591065849449aeb18", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/feb4d81e1722439591065849449aeb18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: be5c51fdd2fe4159a83a560dc074da6b May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.812779 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': 'a3262238-f19e-4c85-b637-99459fd0e59c'} May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:03.813506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.814733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:03.815941 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Returning 404 to user: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:03.815941 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ddf356a7-4a68-4b55-93df-9d743edb60df tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 404 len: 111 microversion: 2.20 time: 0.070933 May 25 16:15:03.815941 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 427/867] 10.222.0.85 () {60 vars in 1279 bytes} [Wed May 25 16:15:03 2022] DELETE /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 25 16:15:03.838844 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:03.839661 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: a3262238-f19e-4c85-b637-99459fd0e59c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:03.856319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:03.856904 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:03.857962 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:03.858592 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:03.888533 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] HTTP exception thrown: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Request method failure captured: May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c HTTP/1.1 May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRfE43-QDxEc85RsAinp1XSohF8nDAtmkYOSPKPYoqGHL2-QM2vUfeqxBmNzpnVtvlRdrJ8XZ-ryQt470EEASTj6gWZgx5UhVaBrNXp9Xo__Px6AsRj8cn8zPbhEcSIyw5IZYNIOAm3nMyHF8hM671merzr857Vwp7QSbwxKSGxog8 May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:15:03.890421 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_feb4d81e1722439591065849449aeb18", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/feb4d81e1722439591065849449aeb18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: be5c51fdd2fe4159a83a560dc074da6b May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.892161 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'a3262238-f19e-4c85-b637-99459fd0e59c'} May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:03.893020 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. May 25 16:15:03.894234 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:03.897052 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Returning 404 to user: Instance a3262238-f19e-4c85-b637-99459fd0e59c could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:03.898315 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4e52acda-f6df-4d7f-b2d6-287d2ebd5ffd tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c" status: 404 len: 111 microversion: 2.20 time: 0.080066 May 25 16:15:03.902266 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 441/868] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:15:03 2022] GET /compute/v2.1/servers/a3262238-f19e-4c85-b637-99459fd0e59c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 16:15:05.167253 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:05.167814 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:05.177382 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:05.177831 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:05.178599 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:05.183393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:05.207901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] HTTP exception thrown: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Request method failure captured: May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: DELETE /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e HTTP/1.1 May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlRfE43-QDxEc85RsAinp1XSohF8nDAtmkYOSPKPYoqGHL2-QM2vUfeqxBmNzpnVtvlRdrJ8XZ-ryQt470EEASTj6gWZgx5UhVaBrNXp9Xo__Px6AsRj8cn8zPbhEcSIyw5IZYNIOAm3nMyHF8hM671merzr857Vwp7QSbwxKSGxog8 May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:15:05.210057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_feb4d81e1722439591065849449aeb18", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/feb4d81e1722439591065849449aeb18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: be5c51fdd2fe4159a83a560dc074da6b May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.211584 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': 'e80a2c16-520b-48e9-9f83-e643414a8c8e'} May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:05.212580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.215021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:05.217751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Returning 404 to user: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:05.217751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c1376ce8-5b72-439b-823b-65209e382a52 tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 404 len: 111 microversion: 2.20 time: 0.049194 May 25 16:15:05.217751 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 428/869] 10.222.0.85 () {60 vars in 1279 bytes} [Wed May 25 16:15:05 2022] DELETE /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 16:15:05.221638 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:05.222316 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] [instance: e80a2c16-520b-48e9-9f83-e643414a8c8e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:05.233829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:05.234285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:05.235082 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:05.235518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:05.262868 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] HTTP exception thrown: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Request method failure captured: May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e HTTP/1.1 May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlRfE43-QDxEc85RsAinp1XSohF8nDAtmkYOSPKPYoqGHL2-QM2vUfeqxBmNzpnVtvlRdrJ8XZ-ryQt470EEASTj6gWZgx5UhVaBrNXp9Xo__Px6AsRj8cn8zPbhEcSIyw5IZYNIOAm3nMyHF8hM671merzr857Vwp7QSbwxKSGxog8 May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Openstack-Nova-Api-Version: 2.20 May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:15:05.267838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_feb4d81e1722439591065849449aeb18", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/feb4d81e1722439591065849449aeb18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/feb4d81e1722439591065849449aeb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: feb4d81e1722439591065849449aeb18 May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1630625586 May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: be5c51fdd2fe4159a83a560dc074da6b May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1630625586-project May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.269550 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'e80a2c16-520b-48e9-9f83-e643414a8c8e'} May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:05.270285 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. May 25 16:15:05.271502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:05.275983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] Returning 404 to user: Instance e80a2c16-520b-48e9-9f83-e643414a8c8e could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:05.277655 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b1558290-bc30-4140-bd5f-3f23a3bf415f tempest-AttachVolumeShelveTestJSON-1630625586 tempest-AttachVolumeShelveTestJSON-1630625586-project] 10.222.0.85 "GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e" status: 404 len: 111 microversion: 2.20 time: 0.059747 May 25 16:15:05.281237 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 442/870] 10.222.0.85 () {60 vars in 1276 bytes} [Wed May 25 16:15:05 2022] GET /compute/v2.1/servers/e80a2c16-520b-48e9-9f83-e643414a8c8e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 16:15:06.497481 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0d67971b-1da5-421e-b08f-466a29eae44e tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Action: 'create', calling method: .version_select at 0x7fbaf00aad30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1676676357", "metadata": {"Type": "work"}}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0d67971b-1da5-421e-b08f-466a29eae44e tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Request method failure captured: May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 122 May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlYKL-xFP1OlCfqWIMwGSrr9Kq94hQI-fjk-26ikX4G0QVfKi9DqMdX9qNhlx5NcSiKCb7Q0c4W6J9Vd5hdZIv9dzWeNOVFZjDvveCuqiyVeTjfiUIxUo9F8RoC3cqmVrQpjoBVHLAIbiCyteJVJcA9hF2kFp8meprOsFK-SJAX6C0Y May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:15:06.514931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_26396353fb464a1ca0f0a7c272d1fe40", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 2047a52f45e7423691d0fb226e7f94fd May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1676676357", "metadata": {"Type": "work"}}} May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: May 25 16:15:06.516743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1676676357', 'metadata': {'Type': 'work'}}}} May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise error May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi '#$%' May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:06.517792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 16:15:06.519335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 16:15:06.520702 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 16:15:06.520702 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.520702 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0d67971b-1da5-421e-b08f-466a29eae44e tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:06.520702 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0d67971b-1da5-421e-b08f-466a29eae44e tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.163048 May 25 16:15:06.520702 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 429/871] 10.222.0.85 () {60 vars in 1155 bytes} [Wed May 25 16:15:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 16:15:06.530414 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7461c542-55e5-4c05-bfa6-a1487c1b71b0 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Action: 'create', calling method: .version_select at 0x7fbae3dd3940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1455965121", "metadata": {"Type": "work"}}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7461c542-55e5-4c05-bfa6-a1487c1b71b0 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Request method failure captured: May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 120 May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlYKL-xFP1OlCfqWIMwGSrr9Kq94hQI-fjk-26ikX4G0QVfKi9DqMdX9qNhlx5NcSiKCb7Q0c4W6J9Vd5hdZIv9dzWeNOVFZjDvveCuqiyVeTjfiUIxUo9F8RoC3cqmVrQpjoBVHLAIbiCyteJVJcA9hF2kFp8meprOsFK-SJAX6C0Y May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:15:06.534281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_26396353fb464a1ca0f0a7c272d1fe40", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 2047a52f45e7423691d0fb226e7f94fd May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1455965121", "metadata": {"Type": "work"}}} May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: May 25 16:15:06.535989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1455965121', 'metadata': {'Type': 'work'}}}} May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise error May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi '0' May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:06.536830 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 16:15:06.538746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 16:15:06.543732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 16:15:06.543732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.543732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7461c542-55e5-4c05-bfa6-a1487c1b71b0 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:06.543732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-7461c542-55e5-4c05-bfa6-a1487c1b71b0 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009750 May 25 16:15:06.543732 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 443/872] 10.222.0.85 () {60 vars in 1155 bytes} [Wed May 25 16:15:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 16:15:06.551074 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-824c6ed2-62cd-48b3-8b62-136553edb115 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Action: 'create', calling method: .version_select at 0x7fbaf00bf1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-810773381", "metadata": {"Type": "work"}}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-824c6ed2-62cd-48b3-8b62-136553edb115 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Request method failure captured: May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 118 May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlYKL-xFP1OlCfqWIMwGSrr9Kq94hQI-fjk-26ikX4G0QVfKi9DqMdX9qNhlx5NcSiKCb7Q0c4W6J9Vd5hdZIv9dzWeNOVFZjDvveCuqiyVeTjfiUIxUo9F8RoC3cqmVrQpjoBVHLAIbiCyteJVJcA9hF2kFp8meprOsFK-SJAX6C0Y May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:15:06.554411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_26396353fb464a1ca0f0a7c272d1fe40", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 2047a52f45e7423691d0fb226e7f94fd May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-810773381", "metadata": {"Type": "work"}}} May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: May 25 16:15:06.556306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-810773381', 'metadata': {'Type': 'work'}}}} May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise error May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi '' May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:06.557191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 16:15:06.558539 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 16:15:06.559699 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 16:15:06.559699 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.559699 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-824c6ed2-62cd-48b3-8b62-136553edb115 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:06.559699 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-824c6ed2-62cd-48b3-8b62-136553edb115 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008728 May 25 16:15:06.559699 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 430/873] 10.222.0.85 () {60 vars in 1155 bytes} [Wed May 25 16:15:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 16:15:06.565951 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-bc0305ca-a7ae-441d-a7ca-9e0f1baa1c8d tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Calling method '.version_select at 0x7fbae3f7ca60>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:06.618132 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-bc0305ca-a7ae-441d-a7ca-9e0f1baa1c8d tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] HTTP exception thrown: Volume tempest-invalid-1415491981 could not be found. May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-bc0305ca-a7ae-441d-a7ca-9e0f1baa1c8d tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Request method failure captured: May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1415491981 HTTP/1.1 May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlYKL-xFP1OlCfqWIMwGSrr9Kq94hQI-fjk-26ikX4G0QVfKi9DqMdX9qNhlx5NcSiKCb7Q0c4W6J9Vd5hdZIv9dzWeNOVFZjDvveCuqiyVeTjfiUIxUo9F8RoC3cqmVrQpjoBVHLAIbiCyteJVJcA9hF2kFp8meprOsFK-SJAX6C0Y May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:15:06.620131 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_26396353fb464a1ca0f0a7c272d1fe40", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 2047a52f45e7423691d0fb226e7f94fd May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Volume tempest-invalid-1415491981 could not be found. May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': 'tempest-invalid-1415491981'} May 25 16:15:06.621654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1415491981 could not be found. (HTTP 404) (Request-ID: req-3ed4e3ac-9921-4b15-9803-d78d36258c8b) May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.622688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:15:06.623869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1415491981 could not be found. May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:15:06.625022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1415491981 could not be found. May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1415491981 could not be found. May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.626505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-bc0305ca-a7ae-441d-a7ca-9e0f1baa1c8d tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Returning 404 to user: Volume tempest-invalid-1415491981 could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:06.630445 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-bc0305ca-a7ae-441d-a7ca-9e0f1baa1c8d tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1415491981" status: 404 len: 99 microversion: 2.1 time: 0.068360 May 25 16:15:06.631187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 444/874] 10.222.0.85 () {58 vars in 1217 bytes} [Wed May 25 16:15:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1415491981 => generated 99 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 25 16:15:06.640601 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-684b2c95-ba37-40e5-ae3b-56e9a602ee3c tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004067 May 25 16:15:06.641569 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 431/875] 10.222.0.85 () {58 vars in 1139 bytes} [Wed May 25 16:15:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 16:15:06.652984 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-13f93dcc-0f48-40d1-a584-8a71abfb189d tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005121 May 25 16:15:06.653890 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 445/876] 10.222.0.85 () {58 vars in 1136 bytes} [Wed May 25 16:15:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 16:15:06.668206 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4dca0a1a-39e7-4c6a-9b3e-a936ebec49c4 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Calling method '.version_select at 0x7fbae3e7f280>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:06.710145 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-4dca0a1a-39e7-4c6a-9b3e-a936ebec49c4 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] HTTP exception thrown: Volume d8a75186-42d2-4bdf-b4d6-ac79c2658138 could not be found. May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4dca0a1a-39e7-4c6a-9b3e-a936ebec49c4 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Request method failure captured: May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: DELETE /compute/v2.1/os-volumes/d8a75186-42d2-4bdf-b4d6-ac79c2658138 HTTP/1.1 May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlYKL-xFP1OlCfqWIMwGSrr9Kq94hQI-fjk-26ikX4G0QVfKi9DqMdX9qNhlx5NcSiKCb7Q0c4W6J9Vd5hdZIv9dzWeNOVFZjDvveCuqiyVeTjfiUIxUo9F8RoC3cqmVrQpjoBVHLAIbiCyteJVJcA9hF2kFp8meprOsFK-SJAX6C0Y May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:15:06.715302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_26396353fb464a1ca0f0a7c272d1fe40", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 2047a52f45e7423691d0fb226e7f94fd May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Volume d8a75186-42d2-4bdf-b4d6-ac79c2658138 could not be found. May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': 'd8a75186-42d2-4bdf-b4d6-ac79c2658138'} May 25 16:15:06.716990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8a75186-42d2-4bdf-b4d6-ac79c2658138 could not be found. (HTTP 404) (Request-ID: req-f8293bc0-658c-4740-a0c4-f6eb3922e917) May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.717921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 16:15:06.719039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8a75186-42d2-4bdf-b4d6-ac79c2658138 could not be found. May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 16:15:06.720176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8a75186-42d2-4bdf-b4d6-ac79c2658138 could not be found. May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8a75186-42d2-4bdf-b4d6-ac79c2658138 could not be found. May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-4dca0a1a-39e7-4c6a-9b3e-a936ebec49c4 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Returning 404 to user: Volume d8a75186-42d2-4bdf-b4d6-ac79c2658138 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-4dca0a1a-39e7-4c6a-9b3e-a936ebec49c4 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/d8a75186-42d2-4bdf-b4d6-ac79c2658138" status: 404 len: 109 microversion: 2.1 time: 0.057843 May 25 16:15:06.721575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 432/877] 10.222.0.85 () {58 vars in 1247 bytes} [Wed May 25 16:15:06 2022] DELETE /compute/v2.1/os-volumes/d8a75186-42d2-4bdf-b4d6-ac79c2658138 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:15:06.731071 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-76299239-6768-4248-81c9-e2e109da1e30 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Calling method '.version_select at 0x7fbaf03b7d30>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:06.769165 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-76299239-6768-4248-81c9-e2e109da1e30 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] HTTP exception thrown: Volume 0fd57b49-5aee-4d02-b60c-d59723fddc5c could not be found. May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-76299239-6768-4248-81c9-e2e109da1e30 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Request method failure captured: May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/os-volumes/0fd57b49-5aee-4d02-b60c-d59723fddc5c HTTP/1.1 May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlYKL-xFP1OlCfqWIMwGSrr9Kq94hQI-fjk-26ikX4G0QVfKi9DqMdX9qNhlx5NcSiKCb7Q0c4W6J9Vd5hdZIv9dzWeNOVFZjDvveCuqiyVeTjfiUIxUo9F8RoC3cqmVrQpjoBVHLAIbiCyteJVJcA9hF2kFp8meprOsFK-SJAX6C0Y May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:15:06.771124 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_26396353fb464a1ca0f0a7c272d1fe40", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/26396353fb464a1ca0f0a7c272d1fe40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 26396353fb464a1ca0f0a7c272d1fe40 May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-VolumesNegativeTest-1073975177 May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 2047a52f45e7423691d0fb226e7f94fd May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-VolumesNegativeTest-1073975177-project May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Volume 0fd57b49-5aee-4d02-b60c-d59723fddc5c could not be found. May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '0fd57b49-5aee-4d02-b60c-d59723fddc5c'} May 25 16:15:06.772462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0fd57b49-5aee-4d02-b60c-d59723fddc5c could not be found. (HTTP 404) (Request-ID: req-64a797f3-6a56-41f4-8de4-a7b25b1fa2dc) May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.773241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 16:15:06.774470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0fd57b49-5aee-4d02-b60c-d59723fddc5c could not be found. May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 16:15:06.775582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0fd57b49-5aee-4d02-b60c-d59723fddc5c could not be found. May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0fd57b49-5aee-4d02-b60c-d59723fddc5c could not be found. May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-76299239-6768-4248-81c9-e2e109da1e30 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] Returning 404 to user: Volume 0fd57b49-5aee-4d02-b60c-d59723fddc5c could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:15:06.777049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-76299239-6768-4248-81c9-e2e109da1e30 tempest-VolumesNegativeTest-1073975177 tempest-VolumesNegativeTest-1073975177-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/0fd57b49-5aee-4d02-b60c-d59723fddc5c" status: 404 len: 109 microversion: 2.1 time: 0.047615 May 25 16:15:06.786819 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 446/878] 10.222.0.85 () {58 vars in 1244 bytes} [Wed May 25 16:15:06 2022] GET /compute/v2.1/os-volumes/0fd57b49-5aee-4d02-b60c-d59723fddc5c => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:15:21.930824 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:21.931588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=89,nova_cell1:UPDATE=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:21.937360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-172469960", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-837019089", "security_groups": [{"name": "tempest-secgroup-smoke-1782594503"}], "networks": [{"uuid": "9358ddcf-9465-4227-b94e-57f9c6a33979"}], "block_device_mapping_v2": [{"uuid": "31fafecc-7b45-44f9-aa9a-55a9accf1e4d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:15:22.069744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] validate_networks() for [('9358ddcf-9465-4227-b94e-57f9c6a33979', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:15:22.743329 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:15:22.743869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:15:22.744720 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:15:22.745257 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:15:22.745883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:15:22.756080 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:22.756521 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:22.757412 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:22.757743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:22.775414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Getting quotas for project 7528adefacfc41c5a54869ec5603bde8. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:15:22.779433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Getting quotas for user abd62b4b16da4dcd8e0bdbcb6d9db3a8 and project 7528adefacfc41c5a54869ec5603bde8. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:15:22.840864 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:15:22.842996 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31fafecc-7b45-44f9-aa9a-55a9accf1e4d',volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:15:22.981309 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8116fbd1-335c-40a2-9bd8-17db44dd14c8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.052540 May 25 16:15:22.987017 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 433/879] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:15:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:15:22.990710 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=4 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:22.991911 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:22.992560 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=8 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:22.997748 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d32819a2-b24e-4e30-bde9-6cc71961f190 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:22.998548 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d32819a2-b24e-4e30-bde9-6cc71961f190 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:23.059674 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d32819a2-b24e-4e30-bde9-6cc71961f190 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:23.066262 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d32819a2-b24e-4e30-bde9-6cc71961f190 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1087 microversion: 2.1 time: 0.077946 May 25 16:15:23.067014 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 447/880] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:22 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1087 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:24.083360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8f677e88-0224-44e7-9969-5ef03e5c3d13 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:24.084641 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8f677e88-0224-44e7-9969-5ef03e5c3d13 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:24.095922 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f677e88-0224-44e7-9969-5ef03e5c3d13 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:24.096478 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f677e88-0224-44e7-9969-5ef03e5c3d13 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:24.097512 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f677e88-0224-44e7-9969-5ef03e5c3d13 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:24.098001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f677e88-0224-44e7-9969-5ef03e5c3d13 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:24.188665 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-8f677e88-0224-44e7-9969-5ef03e5c3d13 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:24.201709 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8f677e88-0224-44e7-9969-5ef03e5c3d13 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1203 microversion: 2.1 time: 0.123091 May 25 16:15:24.202335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 434/881] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:24 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1203 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:25.218891 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-bda363aa-4067-4bbb-918a-fb9c70490940 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:25.219462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-bda363aa-4067-4bbb-918a-fb9c70490940 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:25.225937 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bda363aa-4067-4bbb-918a-fb9c70490940 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:25.226384 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bda363aa-4067-4bbb-918a-fb9c70490940 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:25.227210 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bda363aa-4067-4bbb-918a-fb9c70490940 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:25.227579 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-bda363aa-4067-4bbb-918a-fb9c70490940 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:25.490486 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-bda363aa-4067-4bbb-918a-fb9c70490940 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:25.502004 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-bda363aa-4067-4bbb-918a-fb9c70490940 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.286666 May 25 16:15:25.509862 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 448/882] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:25 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:26.166940 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-86d7c73b-c7b5-462e-9d2b-e6d6d9aa3881 req-f9f99dfe-7a33-4328-9ea3-a989d40c93a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17708ce9-98f7-4676-9cdd-242102969497", "tag": "5aba6c27-f5a6-468a-851f-055752b5ce50"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:15:26.183443 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-86d7c73b-c7b5-462e-9d2b-e6d6d9aa3881 req-f9f99dfe-7a33-4328-9ea3-a989d40c93a5 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:26.184242 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-86d7c73b-c7b5-462e-9d2b-e6d6d9aa3881 req-f9f99dfe-7a33-4328-9ea3-a989d40c93a5 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:26.201813 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-86d7c73b-c7b5-462e-9d2b-e6d6d9aa3881 req-f9f99dfe-7a33-4328-9ea3-a989d40c93a5 service nova] Creating event network-changed:5aba6c27-f5a6-468a-851f-055752b5ce50 for instance 17708ce9-98f7-4676-9cdd-242102969497 on hv-cinder-84327 May 25 16:15:26.210347 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-86d7c73b-c7b5-462e-9d2b-e6d6d9aa3881 req-f9f99dfe-7a33-4328-9ea3-a989d40c93a5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051982 May 25 16:15:26.212146 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 435/883] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:15:26.518777 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-15c87a11-f5ed-4a06-8683-b67e75790b62 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:26.520703 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-15c87a11-f5ed-4a06-8683-b67e75790b62 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:26.528338 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-15c87a11-f5ed-4a06-8683-b67e75790b62 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:26.542081 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-15c87a11-f5ed-4a06-8683-b67e75790b62 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:26.543167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-15c87a11-f5ed-4a06-8683-b67e75790b62 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:26.545042 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-15c87a11-f5ed-4a06-8683-b67e75790b62 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:26.830005 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-15c87a11-f5ed-4a06-8683-b67e75790b62 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:26.845756 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-15c87a11-f5ed-4a06-8683-b67e75790b62 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.330761 May 25 16:15:26.846267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 449/884] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:26 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:15:27.864322 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-024d9780-1b84-442a-9edc-97fb9c56d5cd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:27.865622 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-024d9780-1b84-442a-9edc-97fb9c56d5cd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:27.872173 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-024d9780-1b84-442a-9edc-97fb9c56d5cd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:27.872821 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-024d9780-1b84-442a-9edc-97fb9c56d5cd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:27.873981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-024d9780-1b84-442a-9edc-97fb9c56d5cd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:27.874573 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-024d9780-1b84-442a-9edc-97fb9c56d5cd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:28.033190 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-024d9780-1b84-442a-9edc-97fb9c56d5cd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:28.043560 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-024d9780-1b84-442a-9edc-97fb9c56d5cd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.184383 May 25 16:15:28.044386 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 436/885] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:27 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:29.061854 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-054855c9-4eb0-4e86-88f6-a483c2d45dab tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:29.062529 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-054855c9-4eb0-4e86-88f6-a483c2d45dab tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:29.069460 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-054855c9-4eb0-4e86-88f6-a483c2d45dab tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:29.069909 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-054855c9-4eb0-4e86-88f6-a483c2d45dab tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:29.070681 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-054855c9-4eb0-4e86-88f6-a483c2d45dab tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:29.071117 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-054855c9-4eb0-4e86-88f6-a483c2d45dab tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:29.214843 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-054855c9-4eb0-4e86-88f6-a483c2d45dab tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:29.222714 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-054855c9-4eb0-4e86-88f6-a483c2d45dab tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.165767 May 25 16:15:29.223319 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 450/886] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:29 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:30.244743 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-463736c3-ecbc-46ca-8393-70680b0e3c81 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:30.245590 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-463736c3-ecbc-46ca-8393-70680b0e3c81 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:30.253687 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-463736c3-ecbc-46ca-8393-70680b0e3c81 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:30.254137 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-463736c3-ecbc-46ca-8393-70680b0e3c81 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:30.254904 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-463736c3-ecbc-46ca-8393-70680b0e3c81 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:30.255334 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-463736c3-ecbc-46ca-8393-70680b0e3c81 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:30.385775 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-463736c3-ecbc-46ca-8393-70680b0e3c81 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:30.393461 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-463736c3-ecbc-46ca-8393-70680b0e3c81 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.155671 May 25 16:15:30.394024 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 437/887] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:30 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:31.414746 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cfad3ee7-7ce5-4bb5-99cf-da0c8db7d88c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:31.415801 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cfad3ee7-7ce5-4bb5-99cf-da0c8db7d88c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:31.424487 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfad3ee7-7ce5-4bb5-99cf-da0c8db7d88c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:31.424937 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfad3ee7-7ce5-4bb5-99cf-da0c8db7d88c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:31.425704 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfad3ee7-7ce5-4bb5-99cf-da0c8db7d88c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:31.426136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfad3ee7-7ce5-4bb5-99cf-da0c8db7d88c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:31.568516 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cfad3ee7-7ce5-4bb5-99cf-da0c8db7d88c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:31.576659 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cfad3ee7-7ce5-4bb5-99cf-da0c8db7d88c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.168669 May 25 16:15:31.577196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 451/888] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:31 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:32.596943 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a9656ab7-364d-4cb0-9fc8-3864b24f1c70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:32.597815 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a9656ab7-364d-4cb0-9fc8-3864b24f1c70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:32.606096 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a9656ab7-364d-4cb0-9fc8-3864b24f1c70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:32.606718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a9656ab7-364d-4cb0-9fc8-3864b24f1c70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:32.607759 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a9656ab7-364d-4cb0-9fc8-3864b24f1c70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:32.608429 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a9656ab7-364d-4cb0-9fc8-3864b24f1c70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:32.751809 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a9656ab7-364d-4cb0-9fc8-3864b24f1c70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:32.760219 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a9656ab7-364d-4cb0-9fc8-3864b24f1c70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.169127 May 25 16:15:32.760792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 438/889] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:32 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:33.785694 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-68ae7d5d-4e2e-46a5-82d9-e8e859dce5b1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:33.786529 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-68ae7d5d-4e2e-46a5-82d9-e8e859dce5b1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:33.790237 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:33.799411 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-68ae7d5d-4e2e-46a5-82d9-e8e859dce5b1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:33.800212 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-68ae7d5d-4e2e-46a5-82d9-e8e859dce5b1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:33.801470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-68ae7d5d-4e2e-46a5-82d9-e8e859dce5b1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:33.802190 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-68ae7d5d-4e2e-46a5-82d9-e8e859dce5b1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:33.947803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-68ae7d5d-4e2e-46a5-82d9-e8e859dce5b1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:33.955795 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-68ae7d5d-4e2e-46a5-82d9-e8e859dce5b1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.176929 May 25 16:15:33.956484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 452/890] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:33 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:34.976719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f968649f-6fb9-4082-b3d2-904c401e4e1e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:34.977701 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f968649f-6fb9-4082-b3d2-904c401e4e1e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:34.980859 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:34.982059 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:34.990868 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f968649f-6fb9-4082-b3d2-904c401e4e1e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:34.991319 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f968649f-6fb9-4082-b3d2-904c401e4e1e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:34.992125 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f968649f-6fb9-4082-b3d2-904c401e4e1e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:34.992568 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f968649f-6fb9-4082-b3d2-904c401e4e1e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:35.123068 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f968649f-6fb9-4082-b3d2-904c401e4e1e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:35.131620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f968649f-6fb9-4082-b3d2-904c401e4e1e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.161662 May 25 16:15:35.132231 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 439/891] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:34 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:36.149147 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-cfe9defe-965b-461f-93d0-ebe1a831d7ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:36.149779 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-cfe9defe-965b-461f-93d0-ebe1a831d7ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:36.156993 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfe9defe-965b-461f-93d0-ebe1a831d7ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:36.157517 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfe9defe-965b-461f-93d0-ebe1a831d7ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:36.158416 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfe9defe-965b-461f-93d0-ebe1a831d7ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:36.158843 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-cfe9defe-965b-461f-93d0-ebe1a831d7ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:36.300220 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-cfe9defe-965b-461f-93d0-ebe1a831d7ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:36.309798 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-cfe9defe-965b-461f-93d0-ebe1a831d7ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.164791 May 25 16:15:36.310839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 453/892] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:36 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:37.327995 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c43e70d6-d199-43ff-bbc4-1a3799eefbc6 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:37.328723 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c43e70d6-d199-43ff-bbc4-1a3799eefbc6 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:37.336120 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c43e70d6-d199-43ff-bbc4-1a3799eefbc6 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:37.336516 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c43e70d6-d199-43ff-bbc4-1a3799eefbc6 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:37.337288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c43e70d6-d199-43ff-bbc4-1a3799eefbc6 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:37.337895 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c43e70d6-d199-43ff-bbc4-1a3799eefbc6 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:37.480562 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c43e70d6-d199-43ff-bbc4-1a3799eefbc6 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:37.488142 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c43e70d6-d199-43ff-bbc4-1a3799eefbc6 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.164942 May 25 16:15:37.488720 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 440/893] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:37 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:38.510002 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-70ade288-9ca9-48d0-a563-b16abc4f4b6e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:38.510851 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-70ade288-9ca9-48d0-a563-b16abc4f4b6e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:38.521736 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-70ade288-9ca9-48d0-a563-b16abc4f4b6e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:38.522477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-70ade288-9ca9-48d0-a563-b16abc4f4b6e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:38.523709 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-70ade288-9ca9-48d0-a563-b16abc4f4b6e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:38.524468 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-70ade288-9ca9-48d0-a563-b16abc4f4b6e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:38.673622 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-70ade288-9ca9-48d0-a563-b16abc4f4b6e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:38.681521 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-70ade288-9ca9-48d0-a563-b16abc4f4b6e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.178552 May 25 16:15:38.682119 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 454/894] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:38 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:39.703274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-95b9f187-a487-44ee-bc04-fc5bed004643 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:39.703274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-95b9f187-a487-44ee-bc04-fc5bed004643 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:39.706257 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-95b9f187-a487-44ee-bc04-fc5bed004643 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:39.706712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-95b9f187-a487-44ee-bc04-fc5bed004643 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:39.707519 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-95b9f187-a487-44ee-bc04-fc5bed004643 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:39.707975 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-95b9f187-a487-44ee-bc04-fc5bed004643 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:39.890514 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-95b9f187-a487-44ee-bc04-fc5bed004643 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:39.899213 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-95b9f187-a487-44ee-bc04-fc5bed004643 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.204740 May 25 16:15:39.899938 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 441/895] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:39 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:40.116944 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-58cece59-21b1-4f30-b51d-9bc76fa92720 req-f9da2c95-84ba-48ac-89fe-c2bfa7162c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17708ce9-98f7-4676-9cdd-242102969497", "name": "network-vif-plugged", "status": "completed", "tag": "5aba6c27-f5a6-468a-851f-055752b5ce50"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:15:40.125434 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-58cece59-21b1-4f30-b51d-9bc76fa92720 req-f9da2c95-84ba-48ac-89fe-c2bfa7162c97 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:40.125884 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-58cece59-21b1-4f30-b51d-9bc76fa92720 req-f9da2c95-84ba-48ac-89fe-c2bfa7162c97 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:40.137582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-58cece59-21b1-4f30-b51d-9bc76fa92720 req-f9da2c95-84ba-48ac-89fe-c2bfa7162c97 service nova] Creating event network-vif-plugged:5aba6c27-f5a6-468a-851f-055752b5ce50 for instance 17708ce9-98f7-4676-9cdd-242102969497 on hv-cinder-84327 May 25 16:15:40.143050 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-58cece59-21b1-4f30-b51d-9bc76fa92720 req-f9da2c95-84ba-48ac-89fe-c2bfa7162c97 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029879 May 25 16:15:40.143634 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 455/896] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:15:40.916647 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-06328c40-f1d2-4b8c-8cd9-a207f802b880 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:40.917268 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-06328c40-f1d2-4b8c-8cd9-a207f802b880 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:40.924258 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-06328c40-f1d2-4b8c-8cd9-a207f802b880 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:40.924761 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-06328c40-f1d2-4b8c-8cd9-a207f802b880 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:40.925533 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-06328c40-f1d2-4b8c-8cd9-a207f802b880 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:40.925931 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-06328c40-f1d2-4b8c-8cd9-a207f802b880 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:41.058951 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-06328c40-f1d2-4b8c-8cd9-a207f802b880 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:41.067001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-06328c40-f1d2-4b8c-8cd9-a207f802b880 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.154469 May 25 16:15:41.067593 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 442/897] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:40 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:42.085200 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c23eb765-722f-4f58-bf0a-7a5f8a77e185 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:42.086067 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c23eb765-722f-4f58-bf0a-7a5f8a77e185 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:42.092315 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c23eb765-722f-4f58-bf0a-7a5f8a77e185 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:42.092761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c23eb765-722f-4f58-bf0a-7a5f8a77e185 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:42.093514 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c23eb765-722f-4f58-bf0a-7a5f8a77e185 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:42.093941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c23eb765-722f-4f58-bf0a-7a5f8a77e185 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:42.252258 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c23eb765-722f-4f58-bf0a-7a5f8a77e185 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:42.259631 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c23eb765-722f-4f58-bf0a-7a5f8a77e185 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.179237 May 25 16:15:42.260233 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 456/898] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:42 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:43.280370 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f516d4ec-6531-4704-8d15-5229425d2b52 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:43.282218 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f516d4ec-6531-4704-8d15-5229425d2b52 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:43.290197 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f516d4ec-6531-4704-8d15-5229425d2b52 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:43.290644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f516d4ec-6531-4704-8d15-5229425d2b52 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:43.291621 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f516d4ec-6531-4704-8d15-5229425d2b52 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:43.292079 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f516d4ec-6531-4704-8d15-5229425d2b52 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:43.447052 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f516d4ec-6531-4704-8d15-5229425d2b52 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:43.454553 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f516d4ec-6531-4704-8d15-5229425d2b52 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.181084 May 25 16:15:43.455133 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 443/899] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:43 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:44.472618 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6e93ba87-ffc1-4e4c-98bd-42de603c8e9a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:44.473230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6e93ba87-ffc1-4e4c-98bd-42de603c8e9a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:44.480072 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6e93ba87-ffc1-4e4c-98bd-42de603c8e9a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:44.480535 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6e93ba87-ffc1-4e4c-98bd-42de603c8e9a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:44.481305 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6e93ba87-ffc1-4e4c-98bd-42de603c8e9a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:44.481977 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6e93ba87-ffc1-4e4c-98bd-42de603c8e9a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:44.651268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6e93ba87-ffc1-4e4c-98bd-42de603c8e9a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:44.664648 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6e93ba87-ffc1-4e4c-98bd-42de603c8e9a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1259 microversion: 2.1 time: 0.195733 May 25 16:15:44.665400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 457/900] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:44 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:45.682640 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0b2f2f64-46dd-47a6-a4be-283f690ddb0e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:45.683255 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0b2f2f64-46dd-47a6-a4be-283f690ddb0e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:45.690603 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0b2f2f64-46dd-47a6-a4be-283f690ddb0e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:45.691050 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0b2f2f64-46dd-47a6-a4be-283f690ddb0e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:45.691843 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0b2f2f64-46dd-47a6-a4be-283f690ddb0e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:45.692269 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0b2f2f64-46dd-47a6-a4be-283f690ddb0e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:45.838641 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0b2f2f64-46dd-47a6-a4be-283f690ddb0e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:45.847433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0b2f2f64-46dd-47a6-a4be-283f690ddb0e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1441 microversion: 2.1 time: 0.168659 May 25 16:15:45.848045 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 444/901] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:45 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1441 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:45.866735 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1837f1e6-56cb-4ae5-8870-6f55ee454a23 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:15:45.867502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1837f1e6-56cb-4ae5-8870-6f55ee454a23 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:15:45.874070 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1837f1e6-56cb-4ae5-8870-6f55ee454a23 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:45.874506 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1837f1e6-56cb-4ae5-8870-6f55ee454a23 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:45.875271 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1837f1e6-56cb-4ae5-8870-6f55ee454a23 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:45.875702 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1837f1e6-56cb-4ae5-8870-6f55ee454a23 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:46.024983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1837f1e6-56cb-4ae5-8870-6f55ee454a23 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:15:46.034395 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1837f1e6-56cb-4ae5-8870-6f55ee454a23 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1441 microversion: 2.1 time: 0.172906 May 25 16:15:46.035009 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 458/902] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:15:45 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1441 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:15:47.934985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-b789a351-b36b-4982-a89a-f366e5b970c3 req-ed7a95b8-e3f8-4d6d-a797-e0fb6903f42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17708ce9-98f7-4676-9cdd-242102969497", "tag": "5aba6c27-f5a6-468a-851f-055752b5ce50"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:15:47.943021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-b789a351-b36b-4982-a89a-f366e5b970c3 req-ed7a95b8-e3f8-4d6d-a797-e0fb6903f42e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:15:47.943471 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-b789a351-b36b-4982-a89a-f366e5b970c3 req-ed7a95b8-e3f8-4d6d-a797-e0fb6903f42e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:15:47.954282 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-b789a351-b36b-4982-a89a-f366e5b970c3 req-ed7a95b8-e3f8-4d6d-a797-e0fb6903f42e service nova] Creating event network-changed:5aba6c27-f5a6-468a-851f-055752b5ce50 for instance 17708ce9-98f7-4676-9cdd-242102969497 on hv-cinder-84327 May 25 16:15:47.959434 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-b789a351-b36b-4982-a89a-f366e5b970c3 req-ed7a95b8-e3f8-4d6d-a797-e0fb6903f42e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154017 May 25 16:15:47.960065 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 445/903] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:16:15.714851 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:16:15.715580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Wed May 25 16:16:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:16:34.769503 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4cacc43f-56d9-4952-9c54-201bc6e7d611 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Action: 'create', calling method: .version_select at 0x7fbaf00545e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-845424343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfRu+1T8evifwS6ZFWL/sWvwFONG8rH/Nr+HxOngwU9leJ3RX0N1faUboHYcrNZs86tjvB27S89sLz6vY/xkoGlrRKYfmxyEblRCj8pjqBild8/4i2LafxaGCL59dCmng=="}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:16:34.776902 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=26 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:16:34.777570 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=62 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:16:34.789492 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-4cacc43f-56d9-4952-9c54-201bc6e7d611 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Getting quotas for project e2fbd40b4ea447319a8b90656548da9e. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:16:34.794101 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.quota [None req-4cacc43f-56d9-4952-9c54-201bc6e7d611 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Getting quotas for user 920a00aa201143f6ae4799aff51c6dae and project e2fbd40b4ea447319a8b90656548da9e. Resources: {'key_pairs'} {{(pid=117764) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:16:34.820579 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4cacc43f-56d9-4952-9c54-201bc6e7d611 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058989 May 25 16:16:34.821467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 459/904] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:16:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:16:34.949637 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1321662605", "imageRef": "885815b4-7817-4437-8b69-def488002b33", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-845424343", "networks": [{"uuid": "8b60168c-6e5d-423c-ac81-d56c113725db"}]}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:16:34.961072 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:16:34.961823 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=66 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:16:35.014826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] validate_networks() for [('8b60168c-6e5d-423c-ac81-d56c113725db', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:16:35.428773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:16:35.429502 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:16:35.430145 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:16:35.430707 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:16:35.431277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:16:35.440900 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:35.441585 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:35.442552 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:35.443231 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:35.462880 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Getting quotas for project e2fbd40b4ea447319a8b90656548da9e. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:16:35.468913 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Getting quotas for user 920a00aa201143f6ae4799aff51c6dae and project e2fbd40b4ea447319a8b90656548da9e. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:16:35.483104 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:16:35.485621 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='885815b4-7817-4437-8b69-def488002b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:16:35.542631 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-04003e55-9153-4ecc-b40b-95c17c1073a3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599319 May 25 16:16:35.547882 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 446/905] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:16:35.553983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-457936dd-e200-4352-906f-8811232d0e5e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:35.555430 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-457936dd-e200-4352-906f-8811232d0e5e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:35.658717 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-457936dd-e200-4352-906f-8811232d0e5e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:35.678010 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-457936dd-e200-4352-906f-8811232d0e5e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1258 microversion: 2.1 time: 0.128477 May 25 16:16:35.679291 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 460/906] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:35 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1258 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:36.696139 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ec84156e-339c-4d94-b430-9c1909448a71 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:36.697402 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ec84156e-339c-4d94-b430-9c1909448a71 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:36.704370 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ec84156e-339c-4d94-b430-9c1909448a71 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:36.705243 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ec84156e-339c-4d94-b430-9c1909448a71 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:36.706179 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ec84156e-339c-4d94-b430-9c1909448a71 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:36.706765 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ec84156e-339c-4d94-b430-9c1909448a71 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:36.808043 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ec84156e-339c-4d94-b430-9c1909448a71 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:36.816053 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ec84156e-339c-4d94-b430-9c1909448a71 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1310 microversion: 2.1 time: 0.123852 May 25 16:16:36.816921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 447/907] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:36 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1310 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:37.836046 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-6b9211bd-1bfa-42a4-ba3a-14b9145ba1d6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:37.836710 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-6b9211bd-1bfa-42a4-ba3a-14b9145ba1d6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:37.861389 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6b9211bd-1bfa-42a4-ba3a-14b9145ba1d6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:37.861841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6b9211bd-1bfa-42a4-ba3a-14b9145ba1d6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:37.869837 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6b9211bd-1bfa-42a4-ba3a-14b9145ba1d6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:37.870591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-6b9211bd-1bfa-42a4-ba3a-14b9145ba1d6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:38.497845 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-6b9211bd-1bfa-42a4-ba3a-14b9145ba1d6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:38.525510 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-6b9211bd-1bfa-42a4-ba3a-14b9145ba1d6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.694172 May 25 16:16:38.538693 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 461/908] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:37 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:39.546269 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1c6ecd79-fe27-4607-afba-5825b5080047 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:39.546910 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1c6ecd79-fe27-4607-afba-5825b5080047 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:39.560642 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1c6ecd79-fe27-4607-afba-5825b5080047 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:39.561094 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1c6ecd79-fe27-4607-afba-5825b5080047 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:39.561883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1c6ecd79-fe27-4607-afba-5825b5080047 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:39.562327 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1c6ecd79-fe27-4607-afba-5825b5080047 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:40.231319 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1c6ecd79-fe27-4607-afba-5825b5080047 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:40.245507 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1c6ecd79-fe27-4607-afba-5825b5080047 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.703252 May 25 16:16:40.246607 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 448/909] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:39 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:40.538734 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-93848904-72df-48c2-b9c9-31728874d121 req-b4bd8b6c-15d0-4fe2-974b-66c75f5d504d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a92754-a025-44df-a288-dca82b81ecf8", "tag": "2b47afd8-0e10-4e55-91a9-ef22ee9101ab"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:16:40.560026 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-93848904-72df-48c2-b9c9-31728874d121 req-b4bd8b6c-15d0-4fe2-974b-66c75f5d504d service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:40.560484 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-93848904-72df-48c2-b9c9-31728874d121 req-b4bd8b6c-15d0-4fe2-974b-66c75f5d504d service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:40.591031 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-93848904-72df-48c2-b9c9-31728874d121 req-b4bd8b6c-15d0-4fe2-974b-66c75f5d504d service nova] Creating event network-changed:2b47afd8-0e10-4e55-91a9-ef22ee9101ab for instance d9a92754-a025-44df-a288-dca82b81ecf8 on hv-cinder-84327 May 25 16:16:40.628951 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-93848904-72df-48c2-b9c9-31728874d121 req-b4bd8b6c-15d0-4fe2-974b-66c75f5d504d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093955 May 25 16:16:40.629628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 462/910] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:16:41.264703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1bc6173c-5bde-4f6c-91d2-2e0d189ebb4f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:41.265410 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1bc6173c-5bde-4f6c-91d2-2e0d189ebb4f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:41.275972 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1bc6173c-5bde-4f6c-91d2-2e0d189ebb4f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:41.280327 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1bc6173c-5bde-4f6c-91d2-2e0d189ebb4f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:41.282719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1bc6173c-5bde-4f6c-91d2-2e0d189ebb4f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:41.285591 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1bc6173c-5bde-4f6c-91d2-2e0d189ebb4f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:41.591674 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1bc6173c-5bde-4f6c-91d2-2e0d189ebb4f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:41.600968 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1bc6173c-5bde-4f6c-91d2-2e0d189ebb4f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.341819 May 25 16:16:41.610233 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 449/911] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:41 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:42.617685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0dc05800-3e91-42fb-94b7-eae8b83f8aed tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:42.618386 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0dc05800-3e91-42fb-94b7-eae8b83f8aed tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:42.631838 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0dc05800-3e91-42fb-94b7-eae8b83f8aed tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:42.632253 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0dc05800-3e91-42fb-94b7-eae8b83f8aed tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:42.633082 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0dc05800-3e91-42fb-94b7-eae8b83f8aed tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:42.637519 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0dc05800-3e91-42fb-94b7-eae8b83f8aed tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:42.968858 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0dc05800-3e91-42fb-94b7-eae8b83f8aed tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:42.980341 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0dc05800-3e91-42fb-94b7-eae8b83f8aed tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.366863 May 25 16:16:42.981468 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 463/912] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:42 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:44.004812 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-cd6de829-26ae-4642-816f-e47e578f86af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:44.005872 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-cd6de829-26ae-4642-816f-e47e578f86af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:44.028883 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cd6de829-26ae-4642-816f-e47e578f86af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:44.029365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cd6de829-26ae-4642-816f-e47e578f86af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:44.030178 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cd6de829-26ae-4642-816f-e47e578f86af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:44.033303 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-cd6de829-26ae-4642-816f-e47e578f86af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:44.522617 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-cd6de829-26ae-4642-816f-e47e578f86af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:44.530946 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-cd6de829-26ae-4642-816f-e47e578f86af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.530702 May 25 16:16:44.540906 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 450/913] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:43 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:45.557700 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2dc062f8-9925-4f3f-b2f6-60d288b958f8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:45.558268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2dc062f8-9925-4f3f-b2f6-60d288b958f8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:45.575592 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2dc062f8-9925-4f3f-b2f6-60d288b958f8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:45.578670 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2dc062f8-9925-4f3f-b2f6-60d288b958f8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:45.582051 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2dc062f8-9925-4f3f-b2f6-60d288b958f8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:45.582742 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2dc062f8-9925-4f3f-b2f6-60d288b958f8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:45.678581 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=6 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:16:46.045247 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2dc062f8-9925-4f3f-b2f6-60d288b958f8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:46.056625 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2dc062f8-9925-4f3f-b2f6-60d288b958f8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.503189 May 25 16:16:46.057415 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 464/914] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:45 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:47.074212 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-7c945e14-3444-48d9-b7a3-63d2169e9f42 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:47.079000 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-7c945e14-3444-48d9-b7a3-63d2169e9f42 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:47.086001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:16:47.088444 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:16:47.098763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7c945e14-3444-48d9-b7a3-63d2169e9f42 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:47.099455 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7c945e14-3444-48d9-b7a3-63d2169e9f42 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:47.100480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7c945e14-3444-48d9-b7a3-63d2169e9f42 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:47.100927 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-7c945e14-3444-48d9-b7a3-63d2169e9f42 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:47.443417 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-7c945e14-3444-48d9-b7a3-63d2169e9f42 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:47.456264 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-7c945e14-3444-48d9-b7a3-63d2169e9f42 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.386143 May 25 16:16:47.459889 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 451/915] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:47 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:48.477178 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d297bf5c-0857-473a-883f-889dbbd463b2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:48.478445 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d297bf5c-0857-473a-883f-889dbbd463b2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:48.487426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d297bf5c-0857-473a-883f-889dbbd463b2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:48.490268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d297bf5c-0857-473a-883f-889dbbd463b2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:48.491221 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d297bf5c-0857-473a-883f-889dbbd463b2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:48.492403 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-d297bf5c-0857-473a-883f-889dbbd463b2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:48.736684 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d297bf5c-0857-473a-883f-889dbbd463b2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:48.748481 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d297bf5c-0857-473a-883f-889dbbd463b2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.275551 May 25 16:16:48.749398 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 465/916] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:48 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:49.236106 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e7d26b55-00b3-4a4b-bcae-446a977f72ff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Action: 'create', calling method: .version_select at 0x7fbaf004e0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1131416181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs5ULNW3qSN71HRFahlP2bIHUrgZvt1L+A3b6L1R0VHHlb5R7m3D46oLhbc8CkLXLRlTKZFsrOpQwpriU7yR5kq1mbDNrZdNCtNAR1HkL2pasrNKrg38RmcEUWNPZbiKA=="}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:16:49.253929 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-e7d26b55-00b3-4a4b-bcae-446a977f72ff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Getting quotas for project 31462b97f7a04859b66398fd6386cfc4. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:16:49.258765 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-e7d26b55-00b3-4a4b-bcae-446a977f72ff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Getting quotas for user 67b7bca2e2ef4dbf89554ba2f9bf93e5 and project 31462b97f7a04859b66398fd6386cfc4. Resources: {'key_pairs'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:16:49.290317 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e7d26b55-00b3-4a4b-bcae-446a977f72ff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.280809 May 25 16:16:49.291302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 452/917] 10.222.0.85 () {60 vars in 1158 bytes} [Wed May 25 16:16:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:16:49.767392 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0bdd959e-2a1d-4c9c-ada0-1baa5c9accdc tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:49.768095 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0bdd959e-2a1d-4c9c-ada0-1baa5c9accdc tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:49.776728 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0bdd959e-2a1d-4c9c-ada0-1baa5c9accdc tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:49.777337 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0bdd959e-2a1d-4c9c-ada0-1baa5c9accdc tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:49.778159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0bdd959e-2a1d-4c9c-ada0-1baa5c9accdc tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:49.778737 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0bdd959e-2a1d-4c9c-ada0-1baa5c9accdc tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:49.945339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0bdd959e-2a1d-4c9c-ada0-1baa5c9accdc tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:49.953926 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0bdd959e-2a1d-4c9c-ada0-1baa5c9accdc tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.191281 May 25 16:16:49.954600 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 466/918] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:49 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:50.971549 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c43aef59-043f-4f28-9f75-ab29683aee75 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:50.972599 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c43aef59-043f-4f28-9f75-ab29683aee75 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:50.992171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c43aef59-043f-4f28-9f75-ab29683aee75 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:50.992171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c43aef59-043f-4f28-9f75-ab29683aee75 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:50.992171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c43aef59-043f-4f28-9f75-ab29683aee75 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:50.992171 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c43aef59-043f-4f28-9f75-ab29683aee75 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:51.141054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c43aef59-043f-4f28-9f75-ab29683aee75 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:51.148748 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c43aef59-043f-4f28-9f75-ab29683aee75 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.181717 May 25 16:16:51.149309 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 453/919] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:50 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:52.168509 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-fed0f434-5740-4c46-9e40-cba1b06272c5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:52.170333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-fed0f434-5740-4c46-9e40-cba1b06272c5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:52.186248 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fed0f434-5740-4c46-9e40-cba1b06272c5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:52.188284 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fed0f434-5740-4c46-9e40-cba1b06272c5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:52.189458 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fed0f434-5740-4c46-9e40-cba1b06272c5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:52.190256 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fed0f434-5740-4c46-9e40-cba1b06272c5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:52.371998 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-fed0f434-5740-4c46-9e40-cba1b06272c5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:52.380750 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-fed0f434-5740-4c46-9e40-cba1b06272c5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.217484 May 25 16:16:52.381323 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 467/920] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:52 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:53.401390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1785bf5e-83aa-46fb-a5c8-08efff779b07 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:53.402157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1785bf5e-83aa-46fb-a5c8-08efff779b07 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:53.408718 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1785bf5e-83aa-46fb-a5c8-08efff779b07 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:53.409185 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1785bf5e-83aa-46fb-a5c8-08efff779b07 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:53.409960 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1785bf5e-83aa-46fb-a5c8-08efff779b07 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:53.410899 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1785bf5e-83aa-46fb-a5c8-08efff779b07 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:53.541869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1785bf5e-83aa-46fb-a5c8-08efff779b07 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:53.550270 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1785bf5e-83aa-46fb-a5c8-08efff779b07 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.154771 May 25 16:16:53.550925 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 454/921] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:53 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:54.566523 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-05541fd3-fbee-491f-af76-38843f5a758d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:54.567287 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-05541fd3-fbee-491f-af76-38843f5a758d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:54.577515 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-05541fd3-fbee-491f-af76-38843f5a758d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:54.578062 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-05541fd3-fbee-491f-af76-38843f5a758d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:54.578739 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-05541fd3-fbee-491f-af76-38843f5a758d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:54.579179 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-05541fd3-fbee-491f-af76-38843f5a758d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:54.644687 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-da7c78a1-1197-4ef7-8ba5-122afd27fea9 req-1325bd49-b74d-4288-b5d3-61cb253657ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a92754-a025-44df-a288-dca82b81ecf8", "name": "network-vif-plugged", "status": "completed", "tag": "2b47afd8-0e10-4e55-91a9-ef22ee9101ab"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:16:54.660418 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-da7c78a1-1197-4ef7-8ba5-122afd27fea9 req-1325bd49-b74d-4288-b5d3-61cb253657ab service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:54.661266 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-da7c78a1-1197-4ef7-8ba5-122afd27fea9 req-1325bd49-b74d-4288-b5d3-61cb253657ab service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:54.678876 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-da7c78a1-1197-4ef7-8ba5-122afd27fea9 req-1325bd49-b74d-4288-b5d3-61cb253657ab service nova] Creating event network-vif-plugged:2b47afd8-0e10-4e55-91a9-ef22ee9101ab for instance d9a92754-a025-44df-a288-dca82b81ecf8 on hv-cinder-84327 May 25 16:16:54.685311 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-da7c78a1-1197-4ef7-8ba5-122afd27fea9 req-1325bd49-b74d-4288-b5d3-61cb253657ab service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045944 May 25 16:16:54.686927 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 455/922] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:16:54.763171 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-05541fd3-fbee-491f-af76-38843f5a758d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:54.771960 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-05541fd3-fbee-491f-af76-38843f5a758d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.209226 May 25 16:16:54.772929 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 468/923] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:54 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:55.790350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-14c84f83-624d-487f-89d9-3b2bcc8d0e9b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:55.791057 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-14c84f83-624d-487f-89d9-3b2bcc8d0e9b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:55.798301 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-14c84f83-624d-487f-89d9-3b2bcc8d0e9b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:55.798748 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-14c84f83-624d-487f-89d9-3b2bcc8d0e9b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:55.799525 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-14c84f83-624d-487f-89d9-3b2bcc8d0e9b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:55.800005 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-14c84f83-624d-487f-89d9-3b2bcc8d0e9b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:55.935583 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-14c84f83-624d-487f-89d9-3b2bcc8d0e9b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:55.943486 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-14c84f83-624d-487f-89d9-3b2bcc8d0e9b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1358 microversion: 2.1 time: 0.157771 May 25 16:16:55.944088 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 456/924] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:55 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:56.959966 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-40d66912-ac55-4a85-926c-ec31c93baf3c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:56.960571 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-40d66912-ac55-4a85-926c-ec31c93baf3c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:56.967933 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40d66912-ac55-4a85-926c-ec31c93baf3c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:56.968384 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40d66912-ac55-4a85-926c-ec31c93baf3c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:56.969127 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40d66912-ac55-4a85-926c-ec31c93baf3c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:56.969562 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-40d66912-ac55-4a85-926c-ec31c93baf3c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:57.103183 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-40d66912-ac55-4a85-926c-ec31c93baf3c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:57.112065 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-40d66912-ac55-4a85-926c-ec31c93baf3c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1548 microversion: 2.1 time: 0.156032 May 25 16:16:57.112725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 469/925] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:56 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:57.128182 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f2f22031-dc4f-482d-b835-ed8bc1c4b1af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:57.128987 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f2f22031-dc4f-482d-b835-ed8bc1c4b1af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:57.136588 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f2f22031-dc4f-482d-b835-ed8bc1c4b1af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:57.137024 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f2f22031-dc4f-482d-b835-ed8bc1c4b1af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:57.137855 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f2f22031-dc4f-482d-b835-ed8bc1c4b1af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:57.138296 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f2f22031-dc4f-482d-b835-ed8bc1c4b1af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:57.273390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-f2f22031-dc4f-482d-b835-ed8bc1c4b1af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:57.281321 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f2f22031-dc4f-482d-b835-ed8bc1c4b1af tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1548 microversion: 2.1 time: 0.157095 May 25 16:16:57.281864 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 457/926] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:57 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:57.298761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-21d25ca4-5d3e-4d93-a9b6-8903174b6924 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:57.304382 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-21d25ca4-5d3e-4d93-a9b6-8903174b6924 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:57.304382 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-21d25ca4-5d3e-4d93-a9b6-8903174b6924 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Searching by: {'deleted': False, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e'} {{(pid=117764) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 25 16:16:57.311605 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-21d25ca4-5d3e-4d93-a9b6-8903174b6924 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:57.312783 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-21d25ca4-5d3e-4d93-a9b6-8903174b6924 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:57.312783 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-21d25ca4-5d3e-4d93-a9b6-8903174b6924 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:57.313259 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-21d25ca4-5d3e-4d93-a9b6-8903174b6924 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:57.408923 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.multi_cell_list [None req-21d25ca4-5d3e-4d93-a9b6-8903174b6924 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117764) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 25 16:16:57.514623 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-21d25ca4-5d3e-4d93-a9b6-8903174b6924 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219990 May 25 16:16:57.515238 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 470/927] 10.222.0.85 () {58 vars in 1124 bytes} [Wed May 25 16:16:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:16:57.528349 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9cce57f1-8975-43a7-84ba-d1f3c1fc0f4e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:16:57.528967 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9cce57f1-8975-43a7-84ba-d1f3c1fc0f4e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:57.535157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9cce57f1-8975-43a7-84ba-d1f3c1fc0f4e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:57.535611 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9cce57f1-8975-43a7-84ba-d1f3c1fc0f4e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:57.536403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9cce57f1-8975-43a7-84ba-d1f3c1fc0f4e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:57.536870 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9cce57f1-8975-43a7-84ba-d1f3c1fc0f4e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:57.675054 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9cce57f1-8975-43a7-84ba-d1f3c1fc0f4e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:16:57.683036 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9cce57f1-8975-43a7-84ba-d1f3c1fc0f4e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1548 microversion: 2.1 time: 0.160751 May 25 16:16:57.683648 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 458/928] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:16:57 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:16:59.242251 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b76cfc15-102a-4ca5-95cc-76bf7ad98abe tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c6013f3-9a58-49e2-925b-9dd7d6754736"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:16:59.243420 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b76cfc15-102a-4ca5-95cc-76bf7ad98abe tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:16:59.250923 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b76cfc15-102a-4ca5-95cc-76bf7ad98abe tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:59.251369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b76cfc15-102a-4ca5-95cc-76bf7ad98abe tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:59.252165 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b76cfc15-102a-4ca5-95cc-76bf7ad98abe tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:16:59.252603 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b76cfc15-102a-4ca5-95cc-76bf7ad98abe tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:16:59.526401 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b76cfc15-102a-4ca5-95cc-76bf7ad98abe tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "POST /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288561 May 25 16:16:59.527011 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 471/929] 10.222.0.85 () {60 vars in 1322 bytes} [Wed May 25 16:16:59 2022] POST /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:17:06.085671 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1835174657", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1131416181", "security_groups": [{"name": "tempest-secgroup-smoke-1645907198"}], "block_device_mapping_v2": [{"uuid": "94421079-9e65-40cb-abb2-eab8c42dd3c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8835a77f-3e24-453e-9279-13b9fbf47bf1"}]}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:17:06.094013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=4 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:06.094737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:06.215344 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] validate_networks() for [('8835a77f-3e24-453e-9279-13b9fbf47bf1', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:17:06.599032 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:17:06.599463 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:17:06.599967 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:17:06.600375 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:17:06.600789 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:17:06.610449 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:06.610895 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:06.611694 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:06.612153 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:06.618621 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=65 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:06.631453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Getting quotas for project 31462b97f7a04859b66398fd6386cfc4. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:17:06.635664 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Getting quotas for user 67b7bca2e2ef4dbf89554ba2f9bf93e5 and project 31462b97f7a04859b66398fd6386cfc4. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:17:06.702845 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:17:06.705033 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94421079-9e65-40cb-abb2-eab8c42dd3c6',volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:17:06.842053 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5b0022ae-b830-4632-8c82-2a2decae945d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760373 May 25 16:17:06.842684 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 459/930] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:17:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:17:06.854404 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-d0786b8d-45ed-48dd-9815-029d02552083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:06.855114 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-d0786b8d-45ed-48dd-9815-029d02552083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:06.857116 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:06.918475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-d0786b8d-45ed-48dd-9815-029d02552083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:06.925670 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-d0786b8d-45ed-48dd-9815-029d02552083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1095 microversion: 2.1 time: 0.076212 May 25 16:17:06.926326 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 472/931] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:06 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:07.118593 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-0c83e1dc-6823-4dae-bfd0-890b593837c3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:07.119260 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-0c83e1dc-6823-4dae-bfd0-890b593837c3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:07.126163 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0c83e1dc-6823-4dae-bfd0-890b593837c3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:07.126759 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0c83e1dc-6823-4dae-bfd0-890b593837c3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:07.127371 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0c83e1dc-6823-4dae-bfd0-890b593837c3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:07.127809 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-0c83e1dc-6823-4dae-bfd0-890b593837c3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:07.265038 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-0c83e1dc-6823-4dae-bfd0-890b593837c3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:07.275138 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-0c83e1dc-6823-4dae-bfd0-890b593837c3 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1594 microversion: 2.1 time: 0.161021 May 25 16:17:07.275979 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 460/932] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:07 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:07.945346 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-938a4f6f-d69b-4dd4-9c01-f6b65baf98bd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:07.946032 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-938a4f6f-d69b-4dd4-9c01-f6b65baf98bd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:07.948823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:07.967740 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-938a4f6f-d69b-4dd4-9c01-f6b65baf98bd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:07.968217 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-938a4f6f-d69b-4dd4-9c01-f6b65baf98bd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:07.968983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-938a4f6f-d69b-4dd4-9c01-f6b65baf98bd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:07.969448 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-938a4f6f-d69b-4dd4-9c01-f6b65baf98bd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:07.973981 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:08.055449 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-938a4f6f-d69b-4dd4-9c01-f6b65baf98bd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:08.064472 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-938a4f6f-d69b-4dd4-9c01-f6b65baf98bd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1211 microversion: 2.1 time: 0.125498 May 25 16:17:08.074198 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 473/933] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:07 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:09.082302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c68e667b-bace-4ca3-96ea-457674ae09e4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:09.082921 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c68e667b-bace-4ca3-96ea-457674ae09e4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:09.089549 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c68e667b-bace-4ca3-96ea-457674ae09e4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:09.090288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c68e667b-bace-4ca3-96ea-457674ae09e4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:09.091227 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c68e667b-bace-4ca3-96ea-457674ae09e4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:09.091839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c68e667b-bace-4ca3-96ea-457674ae09e4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:09.123798 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-f3cde6ed-f4e4-4108-bdda-2052b1f034c1 req-cc0f3cfe-e1ca-4b95-8c21-d0de0112abbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a92754-a025-44df-a288-dca82b81ecf8", "tag": "2b47afd8-0e10-4e55-91a9-ef22ee9101ab"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:17:09.138753 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-f3cde6ed-f4e4-4108-bdda-2052b1f034c1 req-cc0f3cfe-e1ca-4b95-8c21-d0de0112abbb service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:09.139201 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-f3cde6ed-f4e4-4108-bdda-2052b1f034c1 req-cc0f3cfe-e1ca-4b95-8c21-d0de0112abbb service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:09.156542 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-f3cde6ed-f4e4-4108-bdda-2052b1f034c1 req-cc0f3cfe-e1ca-4b95-8c21-d0de0112abbb service nova] Creating event network-changed:2b47afd8-0e10-4e55-91a9-ef22ee9101ab for instance d9a92754-a025-44df-a288-dca82b81ecf8 on hv-cinder-84327 May 25 16:17:09.162146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-f3cde6ed-f4e4-4108-bdda-2052b1f034c1 req-cc0f3cfe-e1ca-4b95-8c21-d0de0112abbb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042753 May 25 16:17:09.163382 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 474/934] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:17:09.281980 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c68e667b-bace-4ca3-96ea-457674ae09e4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:09.297167 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c68e667b-bace-4ca3-96ea-457674ae09e4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.214310 May 25 16:17:09.299330 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 461/935] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:09 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:09.626028 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-cf054c85-18e7-49c5-95dc-acc537cfbc84 req-b5fa16ad-02e1-485e-80ff-f7709408b009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c", "tag": "df8efe81-4270-4002-990c-7c522f23f381"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:17:09.651433 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-cf054c85-18e7-49c5-95dc-acc537cfbc84 req-b5fa16ad-02e1-485e-80ff-f7709408b009 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:09.651782 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-cf054c85-18e7-49c5-95dc-acc537cfbc84 req-b5fa16ad-02e1-485e-80ff-f7709408b009 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:09.668188 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-cf054c85-18e7-49c5-95dc-acc537cfbc84 req-b5fa16ad-02e1-485e-80ff-f7709408b009 service nova] Creating event network-changed:df8efe81-4270-4002-990c-7c522f23f381 for instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c on hv-cinder-84327 May 25 16:17:09.676008 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-cf054c85-18e7-49c5-95dc-acc537cfbc84 req-b5fa16ad-02e1-485e-80ff-f7709408b009 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054452 May 25 16:17:09.681274 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 475/936] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:17:10.313137 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-45cad1cb-ab5d-4223-950c-79357baa2fdb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:10.313832 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-45cad1cb-ab5d-4223-950c-79357baa2fdb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:10.325637 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45cad1cb-ab5d-4223-950c-79357baa2fdb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:10.326862 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45cad1cb-ab5d-4223-950c-79357baa2fdb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:10.329150 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45cad1cb-ab5d-4223-950c-79357baa2fdb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:10.329856 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-45cad1cb-ab5d-4223-950c-79357baa2fdb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:10.502991 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-45cad1cb-ab5d-4223-950c-79357baa2fdb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:10.510793 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-45cad1cb-ab5d-4223-950c-79357baa2fdb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.201488 May 25 16:17:10.511919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 462/937] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:10 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:10.767219 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5bcb6dee-8831-43b1-835c-34dfd7fb2b7c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-289554726"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:17:10.767797 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5bcb6dee-8831-43b1-835c-34dfd7fb2b7c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:10.774477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5bcb6dee-8831-43b1-835c-34dfd7fb2b7c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:10.774928 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5bcb6dee-8831-43b1-835c-34dfd7fb2b7c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:10.775691 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5bcb6dee-8831-43b1-835c-34dfd7fb2b7c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:10.776145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5bcb6dee-8831-43b1-835c-34dfd7fb2b7c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:10.998945 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.network.security_group_api [None req-5bcb6dee-8831-43b1-835c-34dfd7fb2b7c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Adding security group a861fe6b-ba0e-452a-84be-18c1567ae7ed to port 2b47afd8-0e10-4e55-91a9-ef22ee9101ab May 25 16:17:11.531904 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9501897a-ef37-464f-a14e-676b2551cd33 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:11.533363 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9501897a-ef37-464f-a14e-676b2551cd33 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:11.544228 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5bcb6dee-8831-43b1-835c-34dfd7fb2b7c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "POST /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/action" status: 202 len: 0 microversion: 2.1 time: 0.779159 May 25 16:17:11.545685 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 476/938] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:17:10 2022] POST /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/action => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:17:11.560463 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9d9ec516-5923-4b10-8d25-010b92fba11d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:11.563525 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9d9ec516-5923-4b10-8d25-010b92fba11d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:11.572628 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9501897a-ef37-464f-a14e-676b2551cd33 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:11.574311 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9501897a-ef37-464f-a14e-676b2551cd33 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:11.575677 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9501897a-ef37-464f-a14e-676b2551cd33 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:11.580715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9d9ec516-5923-4b10-8d25-010b92fba11d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:11.581336 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9501897a-ef37-464f-a14e-676b2551cd33 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:11.586514 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9d9ec516-5923-4b10-8d25-010b92fba11d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:11.588658 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9d9ec516-5923-4b10-8d25-010b92fba11d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:11.590675 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9d9ec516-5923-4b10-8d25-010b92fba11d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:11.743341 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9501897a-ef37-464f-a14e-676b2551cd33 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:11.754481 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9501897a-ef37-464f-a14e-676b2551cd33 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.227810 May 25 16:17:11.765919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 463/939] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:11 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:11.771166 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-4dac7ae7-5e19-4cc2-8024-275e52c6c3d5 req-dd2bde2e-0b3b-457f-81e5-a1f671a039a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a92754-a025-44df-a288-dca82b81ecf8", "tag": "2b47afd8-0e10-4e55-91a9-ef22ee9101ab"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:17:11.779871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-4dac7ae7-5e19-4cc2-8024-275e52c6c3d5 req-dd2bde2e-0b3b-457f-81e5-a1f671a039a1 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:11.780395 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-4dac7ae7-5e19-4cc2-8024-275e52c6c3d5 req-dd2bde2e-0b3b-457f-81e5-a1f671a039a1 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:11.792660 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-4dac7ae7-5e19-4cc2-8024-275e52c6c3d5 req-dd2bde2e-0b3b-457f-81e5-a1f671a039a1 service nova] Creating event network-changed:2b47afd8-0e10-4e55-91a9-ef22ee9101ab for instance d9a92754-a025-44df-a288-dca82b81ecf8 on hv-cinder-84327 May 25 16:17:11.796720 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-9d9ec516-5923-4b10-8d25-010b92fba11d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:11.798302 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-4dac7ae7-5e19-4cc2-8024-275e52c6c3d5 req-dd2bde2e-0b3b-457f-81e5-a1f671a039a1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030918 May 25 16:17:11.799216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 464/940] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:17:11.805770 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9d9ec516-5923-4b10-8d25-010b92fba11d tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1758 microversion: 2.1 time: 0.256178 May 25 16:17:11.806462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 477/941] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:11 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1758 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:17:12.778098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-bbd7433e-7ec3-4e2a-a649-331f3226c45e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:12.779122 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-bbd7433e-7ec3-4e2a-a649-331f3226c45e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:12.788161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bbd7433e-7ec3-4e2a-a649-331f3226c45e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:12.788608 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bbd7433e-7ec3-4e2a-a649-331f3226c45e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:12.789643 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bbd7433e-7ec3-4e2a-a649-331f3226c45e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:12.790162 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bbd7433e-7ec3-4e2a-a649-331f3226c45e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:13.201335 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-bbd7433e-7ec3-4e2a-a649-331f3226c45e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:13.209173 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-bbd7433e-7ec3-4e2a-a649-331f3226c45e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.438613 May 25 16:17:13.209748 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 465/942] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:12 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:14.226496 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ebda44e9-3f5d-4684-bb60-65bc985d7ef4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:14.227115 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ebda44e9-3f5d-4684-bb60-65bc985d7ef4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:14.234034 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ebda44e9-3f5d-4684-bb60-65bc985d7ef4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:14.234477 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ebda44e9-3f5d-4684-bb60-65bc985d7ef4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:14.235228 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ebda44e9-3f5d-4684-bb60-65bc985d7ef4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:14.235621 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ebda44e9-3f5d-4684-bb60-65bc985d7ef4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:14.375208 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ebda44e9-3f5d-4684-bb60-65bc985d7ef4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:14.382942 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ebda44e9-3f5d-4684-bb60-65bc985d7ef4 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.160428 May 25 16:17:14.383508 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 478/943] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:14 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:15.404863 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fabb7d6e-2687-405a-acfa-57c33ab564e5 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:15.405885 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fabb7d6e-2687-405a-acfa-57c33ab564e5 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:15.418508 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fabb7d6e-2687-405a-acfa-57c33ab564e5 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:15.419301 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fabb7d6e-2687-405a-acfa-57c33ab564e5 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:15.420626 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fabb7d6e-2687-405a-acfa-57c33ab564e5 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:15.421365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fabb7d6e-2687-405a-acfa-57c33ab564e5 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:15.556014 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fabb7d6e-2687-405a-acfa-57c33ab564e5 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:15.563695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fabb7d6e-2687-405a-acfa-57c33ab564e5 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.165430 May 25 16:17:15.564203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 466/944] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:15 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:16.583566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f8a5f488-0585-4988-aeba-bd2a1055e248 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:16.584206 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f8a5f488-0585-4988-aeba-bd2a1055e248 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:16.591067 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f8a5f488-0585-4988-aeba-bd2a1055e248 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:16.591521 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f8a5f488-0585-4988-aeba-bd2a1055e248 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:16.592333 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f8a5f488-0585-4988-aeba-bd2a1055e248 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:16.592769 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f8a5f488-0585-4988-aeba-bd2a1055e248 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:16.730011 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f8a5f488-0585-4988-aeba-bd2a1055e248 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:16.737540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f8a5f488-0585-4988-aeba-bd2a1055e248 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.159384 May 25 16:17:16.738171 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 479/945] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:16 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:17.758882 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-87637b0d-e0c5-4dfc-9a34-011fc6430e75 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:17.759878 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-87637b0d-e0c5-4dfc-9a34-011fc6430e75 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:17.763665 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:17.765109 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:17.774834 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-87637b0d-e0c5-4dfc-9a34-011fc6430e75 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:17.775587 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-87637b0d-e0c5-4dfc-9a34-011fc6430e75 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:17.776908 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-87637b0d-e0c5-4dfc-9a34-011fc6430e75 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:17.777610 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-87637b0d-e0c5-4dfc-9a34-011fc6430e75 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:17.918325 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-87637b0d-e0c5-4dfc-9a34-011fc6430e75 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:17.926488 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-87637b0d-e0c5-4dfc-9a34-011fc6430e75 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.174290 May 25 16:17:17.927065 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 467/946] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:17 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:18.942860 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a98a2d8a-f5d7-439e-9ba1-0a562802dac1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:18.944118 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a98a2d8a-f5d7-439e-9ba1-0a562802dac1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:18.946082 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:18.952249 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a98a2d8a-f5d7-439e-9ba1-0a562802dac1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:18.952700 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a98a2d8a-f5d7-439e-9ba1-0a562802dac1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:18.953467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a98a2d8a-f5d7-439e-9ba1-0a562802dac1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:18.953911 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a98a2d8a-f5d7-439e-9ba1-0a562802dac1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:19.091568 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a98a2d8a-f5d7-439e-9ba1-0a562802dac1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:19.099414 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a98a2d8a-f5d7-439e-9ba1-0a562802dac1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.160410 May 25 16:17:19.108900 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 480/947] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:18 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:20.120597 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-23e68441-8b03-4d58-9cb6-5ea6da885083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:20.121528 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-23e68441-8b03-4d58-9cb6-5ea6da885083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:20.131502 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-23e68441-8b03-4d58-9cb6-5ea6da885083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:20.131987 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-23e68441-8b03-4d58-9cb6-5ea6da885083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:20.132786 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-23e68441-8b03-4d58-9cb6-5ea6da885083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:20.133228 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-23e68441-8b03-4d58-9cb6-5ea6da885083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:20.270737 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-23e68441-8b03-4d58-9cb6-5ea6da885083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:20.279160 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-23e68441-8b03-4d58-9cb6-5ea6da885083 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.165324 May 25 16:17:20.280038 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 468/948] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:20 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:20.768982 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-79b44d3e-d961-48d7-9d5d-821a95672b17 req-79953497-5110-4690-961d-938662042c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c", "name": "network-vif-plugged", "status": "completed", "tag": "df8efe81-4270-4002-990c-7c522f23f381"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:17:20.779490 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-79b44d3e-d961-48d7-9d5d-821a95672b17 req-79953497-5110-4690-961d-938662042c13 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:20.779981 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-79b44d3e-d961-48d7-9d5d-821a95672b17 req-79953497-5110-4690-961d-938662042c13 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:20.791850 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-79b44d3e-d961-48d7-9d5d-821a95672b17 req-79953497-5110-4690-961d-938662042c13 service nova] Creating event network-vif-plugged:df8efe81-4270-4002-990c-7c522f23f381 for instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c on hv-cinder-84327 May 25 16:17:20.796572 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-79b44d3e-d961-48d7-9d5d-821a95672b17 req-79953497-5110-4690-961d-938662042c13 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031243 May 25 16:17:20.797157 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 481/949] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:17:21.300497 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-94406a55-c537-4c0b-aef7-febde24f6333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:21.301453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-94406a55-c537-4c0b-aef7-febde24f6333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:21.308589 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-94406a55-c537-4c0b-aef7-febde24f6333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:21.309037 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-94406a55-c537-4c0b-aef7-febde24f6333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:21.309806 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-94406a55-c537-4c0b-aef7-febde24f6333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:21.310241 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-94406a55-c537-4c0b-aef7-febde24f6333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:21.452459 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-94406a55-c537-4c0b-aef7-febde24f6333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:21.462025 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-94406a55-c537-4c0b-aef7-febde24f6333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.168285 May 25 16:17:21.462637 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 469/950] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:21 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:22.486960 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-13104eac-7e66-474e-ae6b-474ad7355aff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:22.488158 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-13104eac-7e66-474e-ae6b-474ad7355aff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:22.498655 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-13104eac-7e66-474e-ae6b-474ad7355aff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:22.499392 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-13104eac-7e66-474e-ae6b-474ad7355aff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:22.500686 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-13104eac-7e66-474e-ae6b-474ad7355aff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:22.501400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-13104eac-7e66-474e-ae6b-474ad7355aff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:22.644926 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-13104eac-7e66-474e-ae6b-474ad7355aff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:22.653014 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-13104eac-7e66-474e-ae6b-474ad7355aff tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1267 microversion: 2.1 time: 0.173850 May 25 16:17:22.653558 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 482/951] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:22 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:23.674072 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3e18d08f-8252-43c2-b335-32eb440bad6a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:23.675080 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3e18d08f-8252-43c2-b335-32eb440bad6a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:23.684688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3e18d08f-8252-43c2-b335-32eb440bad6a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:23.692238 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3e18d08f-8252-43c2-b335-32eb440bad6a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:23.693822 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3e18d08f-8252-43c2-b335-32eb440bad6a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:23.694267 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3e18d08f-8252-43c2-b335-32eb440bad6a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:23.833252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-3e18d08f-8252-43c2-b335-32eb440bad6a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:23.840898 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3e18d08f-8252-43c2-b335-32eb440bad6a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1454 microversion: 2.1 time: 0.173298 May 25 16:17:23.841468 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 470/952] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:23 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:23.859812 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-e5ad7fa8-0ab0-4955-820e-b070c84d3e3d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:23.860486 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-e5ad7fa8-0ab0-4955-820e-b070c84d3e3d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:23.867210 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5ad7fa8-0ab0-4955-820e-b070c84d3e3d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:23.867652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5ad7fa8-0ab0-4955-820e-b070c84d3e3d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:23.868462 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5ad7fa8-0ab0-4955-820e-b070c84d3e3d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:23.868887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-e5ad7fa8-0ab0-4955-820e-b070c84d3e3d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:24.007271 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-e5ad7fa8-0ab0-4955-820e-b070c84d3e3d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:24.019237 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-e5ad7fa8-0ab0-4955-820e-b070c84d3e3d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1454 microversion: 2.1 time: 0.162939 May 25 16:17:24.020039 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 483/953] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:23 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:25.833910 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-0f984256-0061-44d7-8bef-cf3ab7439e28 req-7f098fca-7610-43c2-b5f3-024b7002a503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c", "tag": "df8efe81-4270-4002-990c-7c522f23f381"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:17:25.842564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-0f984256-0061-44d7-8bef-cf3ab7439e28 req-7f098fca-7610-43c2-b5f3-024b7002a503 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:25.843001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-0f984256-0061-44d7-8bef-cf3ab7439e28 req-7f098fca-7610-43c2-b5f3-024b7002a503 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:25.854982 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-0f984256-0061-44d7-8bef-cf3ab7439e28 req-7f098fca-7610-43c2-b5f3-024b7002a503 service nova] Creating event network-changed:df8efe81-4270-4002-990c-7c522f23f381 for instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c on hv-cinder-84327 May 25 16:17:25.860397 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-0f984256-0061-44d7-8bef-cf3ab7439e28 req-7f098fca-7610-43c2-b5f3-024b7002a503 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030555 May 25 16:17:25.861021 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 471/954] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:17:35.463690 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-9afacad8-01c1-440e-987b-098c55f3e9a8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:17:35.464963 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-9afacad8-01c1-440e-987b-098c55f3e9a8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:35.467507 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=25 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:35.468205 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=51 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:35.474443 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9afacad8-01c1-440e-987b-098c55f3e9a8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:35.474893 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9afacad8-01c1-440e-987b-098c55f3e9a8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:35.475652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9afacad8-01c1-440e-987b-098c55f3e9a8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:35.476122 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-9afacad8-01c1-440e-987b-098c55f3e9a8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:35.560781 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-9afacad8-01c1-440e-987b-098c55f3e9a8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "POST /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/action" status: 202 len: 0 microversion: 2.1 time: 0.103622 May 25 16:17:35.561317 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 484/955] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:17:35 2022] POST /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:17:35.570184 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9d7fb202-e0af-4377-b076-1b9f4c127ed9 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:35.570902 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9d7fb202-e0af-4377-b076-1b9f4c127ed9 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:35.578460 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9d7fb202-e0af-4377-b076-1b9f4c127ed9 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:35.578996 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9d7fb202-e0af-4377-b076-1b9f4c127ed9 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:35.579916 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9d7fb202-e0af-4377-b076-1b9f4c127ed9 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:35.580463 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9d7fb202-e0af-4377-b076-1b9f4c127ed9 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:35.733131 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9d7fb202-e0af-4377-b076-1b9f4c127ed9 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:35.741803 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9d7fb202-e0af-4377-b076-1b9f4c127ed9 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1750 microversion: 2.1 time: 0.175859 May 25 16:17:35.742467 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 472/956] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:35 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:36.765206 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-46308ef6-1e52-4075-8a08-0825c979267f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:36.766341 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-46308ef6-1e52-4075-8a08-0825c979267f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:36.778084 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-46308ef6-1e52-4075-8a08-0825c979267f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:36.778528 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-46308ef6-1e52-4075-8a08-0825c979267f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:36.779291 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-46308ef6-1e52-4075-8a08-0825c979267f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:36.779725 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-46308ef6-1e52-4075-8a08-0825c979267f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:36.932842 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-46308ef6-1e52-4075-8a08-0825c979267f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:36.941502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-46308ef6-1e52-4075-8a08-0825c979267f tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1755 microversion: 2.1 time: 0.183883 May 25 16:17:36.942079 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 485/957] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:36 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:37.963320 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d16f9c6c-f40d-4732-a448-c477114600ae tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:37.964312 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d16f9c6c-f40d-4732-a448-c477114600ae tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:37.967671 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:37.976692 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d16f9c6c-f40d-4732-a448-c477114600ae tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:37.977414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d16f9c6c-f40d-4732-a448-c477114600ae tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:37.978669 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d16f9c6c-f40d-4732-a448-c477114600ae tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:37.979376 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d16f9c6c-f40d-4732-a448-c477114600ae tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:37.983330 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=72 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:38.120971 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d16f9c6c-f40d-4732-a448-c477114600ae tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:38.129662 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d16f9c6c-f40d-4732-a448-c477114600ae tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1755 microversion: 2.1 time: 0.172828 May 25 16:17:38.130381 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 473/958] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:37 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:39.150340 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5104b18c-c9f2-4e40-85ad-02377f955d65 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:39.151716 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5104b18c-c9f2-4e40-85ad-02377f955d65 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:39.159504 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5104b18c-c9f2-4e40-85ad-02377f955d65 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:39.159989 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5104b18c-c9f2-4e40-85ad-02377f955d65 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:39.160758 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5104b18c-c9f2-4e40-85ad-02377f955d65 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:39.161197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5104b18c-c9f2-4e40-85ad-02377f955d65 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:39.315078 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5104b18c-c9f2-4e40-85ad-02377f955d65 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:39.323591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5104b18c-c9f2-4e40-85ad-02377f955d65 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1755 microversion: 2.1 time: 0.179870 May 25 16:17:39.324216 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 486/959] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:39 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:40.341330 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e62bffe6-b52a-4fec-87d7-faf3c128acb6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:40.341965 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e62bffe6-b52a-4fec-87d7-faf3c128acb6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:40.348985 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e62bffe6-b52a-4fec-87d7-faf3c128acb6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:40.349446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e62bffe6-b52a-4fec-87d7-faf3c128acb6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:40.350218 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e62bffe6-b52a-4fec-87d7-faf3c128acb6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:40.350660 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e62bffe6-b52a-4fec-87d7-faf3c128acb6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:40.493063 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e62bffe6-b52a-4fec-87d7-faf3c128acb6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:40.501961 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e62bffe6-b52a-4fec-87d7-faf3c128acb6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1755 microversion: 2.1 time: 0.164687 May 25 16:17:40.502561 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 474/960] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:40 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:41.523590 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4d54d41e-81cd-46dd-b614-fe67072987f2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:41.524642 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4d54d41e-81cd-46dd-b614-fe67072987f2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:41.536436 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4d54d41e-81cd-46dd-b614-fe67072987f2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:41.537207 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4d54d41e-81cd-46dd-b614-fe67072987f2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:41.538451 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4d54d41e-81cd-46dd-b614-fe67072987f2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:41.539180 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4d54d41e-81cd-46dd-b614-fe67072987f2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:41.689475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4d54d41e-81cd-46dd-b614-fe67072987f2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:41.702049 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4d54d41e-81cd-46dd-b614-fe67072987f2 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1755 microversion: 2.1 time: 0.184896 May 25 16:17:41.702798 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 487/961] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:41 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:42.723659 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a4530ed2-87d8-41a2-8990-578e659ce2b4 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:42.724426 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a4530ed2-87d8-41a2-8990-578e659ce2b4 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:42.732416 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a4530ed2-87d8-41a2-8990-578e659ce2b4 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:42.732942 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a4530ed2-87d8-41a2-8990-578e659ce2b4 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:42.733836 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a4530ed2-87d8-41a2-8990-578e659ce2b4 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:42.734337 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a4530ed2-87d8-41a2-8990-578e659ce2b4 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:42.910594 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a4530ed2-87d8-41a2-8990-578e659ce2b4 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:42.919227 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a4530ed2-87d8-41a2-8990-578e659ce2b4 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1755 microversion: 2.1 time: 0.201865 May 25 16:17:42.919806 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 475/962] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:42 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:43.938158 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2f56a1be-a575-4e1b-93f0-4a669e08ba17 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:43.938866 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2f56a1be-a575-4e1b-93f0-4a669e08ba17 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:43.946692 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f56a1be-a575-4e1b-93f0-4a669e08ba17 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:43.947197 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f56a1be-a575-4e1b-93f0-4a669e08ba17 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:43.948087 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f56a1be-a575-4e1b-93f0-4a669e08ba17 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:43.948575 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f56a1be-a575-4e1b-93f0-4a669e08ba17 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:44.090747 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2f56a1be-a575-4e1b-93f0-4a669e08ba17 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:44.099082 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2f56a1be-a575-4e1b-93f0-4a669e08ba17 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1755 microversion: 2.1 time: 0.165286 May 25 16:17:44.099652 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 488/963] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:43 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:45.119241 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a788b436-3a51-4e78-add4-de84003180c8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:45.119933 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a788b436-3a51-4e78-add4-de84003180c8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:45.126854 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a788b436-3a51-4e78-add4-de84003180c8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:45.127279 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a788b436-3a51-4e78-add4-de84003180c8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:45.128227 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a788b436-3a51-4e78-add4-de84003180c8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:45.128661 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a788b436-3a51-4e78-add4-de84003180c8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:45.273536 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a788b436-3a51-4e78-add4-de84003180c8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:45.282137 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a788b436-3a51-4e78-add4-de84003180c8 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1755 microversion: 2.1 time: 0.168350 May 25 16:17:45.282703 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 476/964] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:45 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:46.305451 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-29e28df2-3a69-4da2-9d08-89962c8eea68 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:46.306246 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-29e28df2-3a69-4da2-9d08-89962c8eea68 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:46.317829 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29e28df2-3a69-4da2-9d08-89962c8eea68 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:46.318704 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29e28df2-3a69-4da2-9d08-89962c8eea68 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:46.319919 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29e28df2-3a69-4da2-9d08-89962c8eea68 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:46.320853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-29e28df2-3a69-4da2-9d08-89962c8eea68 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:46.478749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-29e28df2-3a69-4da2-9d08-89962c8eea68 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:46.487280 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-29e28df2-3a69-4da2-9d08-89962c8eea68 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1755 microversion: 2.1 time: 0.187956 May 25 16:17:46.487879 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 489/965] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:46 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:17:47.504876 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ff2c28f3-a04f-4a95-8963-117adf926cad tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:17:47.505530 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ff2c28f3-a04f-4a95-8963-117adf926cad tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:17:47.513726 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ff2c28f3-a04f-4a95-8963-117adf926cad tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:47.514211 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ff2c28f3-a04f-4a95-8963-117adf926cad tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:47.515102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ff2c28f3-a04f-4a95-8963-117adf926cad tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:17:47.515571 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ff2c28f3-a04f-4a95-8963-117adf926cad tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:17:47.670981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ff2c28f3-a04f-4a95-8963-117adf926cad tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:17:47.679030 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ff2c28f3-a04f-4a95-8963-117adf926cad tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1758 microversion: 2.1 time: 0.178107 May 25 16:17:47.679572 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 477/966] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:17:47 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:06.283620 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2acd1933-1f25-4882-ac5f-4024d4482799 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:18:06.284249 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2acd1933-1f25-4882-ac5f-4024d4482799 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:06.286351 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=12 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:06.287030 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:06.293516 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2acd1933-1f25-4882-ac5f-4024d4482799 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:06.293967 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2acd1933-1f25-4882-ac5f-4024d4482799 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:06.294748 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2acd1933-1f25-4882-ac5f-4024d4482799 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:06.295187 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2acd1933-1f25-4882-ac5f-4024d4482799 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:06.321431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-2acd1933-1f25-4882-ac5f-4024d4482799 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lazy-loading 'flavor' on Instance uuid 17708ce9-98f7-4676-9cdd-242102969497 {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:18:06.393166 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2acd1933-1f25-4882-ac5f-4024d4482799 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "POST /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497/action" status: 202 len: 0 microversion: 2.1 time: 0.115012 May 25 16:18:06.393736 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 490/967] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:18:06 2022] POST /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:18:06.402805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fd03329c-08c9-4fbf-9d9f-b504686ae0df tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:06.403414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fd03329c-08c9-4fbf-9d9f-b504686ae0df tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:06.405731 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=9 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:06.406390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=29 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:06.412549 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fd03329c-08c9-4fbf-9d9f-b504686ae0df tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:06.413355 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fd03329c-08c9-4fbf-9d9f-b504686ae0df tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:06.415013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fd03329c-08c9-4fbf-9d9f-b504686ae0df tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:06.415516 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fd03329c-08c9-4fbf-9d9f-b504686ae0df tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:06.668074 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-fd03329c-08c9-4fbf-9d9f-b504686ae0df tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:06.676118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fd03329c-08c9-4fbf-9d9f-b504686ae0df tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.277817 May 25 16:18:06.676688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 478/968] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:06 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:07.703744 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b1c8196c-e891-4f68-b425-e734f5a0cb6c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:07.704894 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b1c8196c-e891-4f68-b425-e734f5a0cb6c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:07.715502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1c8196c-e891-4f68-b425-e734f5a0cb6c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:07.716295 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1c8196c-e891-4f68-b425-e734f5a0cb6c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:07.717604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1c8196c-e891-4f68-b425-e734f5a0cb6c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:07.718379 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b1c8196c-e891-4f68-b425-e734f5a0cb6c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:08.164331 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b1c8196c-e891-4f68-b425-e734f5a0cb6c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:08.171961 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b1c8196c-e891-4f68-b425-e734f5a0cb6c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.476191 May 25 16:18:08.172506 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 491/969] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:07 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:09.193871 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c569950d-59ad-4804-9159-afd88d06ff82 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:09.194854 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c569950d-59ad-4804-9159-afd88d06ff82 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:09.206285 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c569950d-59ad-4804-9159-afd88d06ff82 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:09.207039 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c569950d-59ad-4804-9159-afd88d06ff82 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:09.208357 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c569950d-59ad-4804-9159-afd88d06ff82 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:09.209090 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c569950d-59ad-4804-9159-afd88d06ff82 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:09.354744 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-c569950d-59ad-4804-9159-afd88d06ff82 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:09.362433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c569950d-59ad-4804-9159-afd88d06ff82 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.175362 May 25 16:18:09.362998 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 479/970] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:09 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:10.388768 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-64c9ba6b-35cc-480a-8bb8-aa63f2c4c5fd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:10.389728 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-64c9ba6b-35cc-480a-8bb8-aa63f2c4c5fd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:10.397671 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64c9ba6b-35cc-480a-8bb8-aa63f2c4c5fd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:10.398112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64c9ba6b-35cc-480a-8bb8-aa63f2c4c5fd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:10.398871 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64c9ba6b-35cc-480a-8bb8-aa63f2c4c5fd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:10.399296 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-64c9ba6b-35cc-480a-8bb8-aa63f2c4c5fd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:10.531990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-64c9ba6b-35cc-480a-8bb8-aa63f2c4c5fd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:10.540167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-64c9ba6b-35cc-480a-8bb8-aa63f2c4c5fd tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.157826 May 25 16:18:10.540729 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 492/971] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:10 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:11.557774 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b4d17af2-2a16-4786-9188-cbeb6703fad5 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:11.558365 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b4d17af2-2a16-4786-9188-cbeb6703fad5 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:11.566197 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b4d17af2-2a16-4786-9188-cbeb6703fad5 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:11.566586 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b4d17af2-2a16-4786-9188-cbeb6703fad5 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:11.567363 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b4d17af2-2a16-4786-9188-cbeb6703fad5 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:11.567804 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b4d17af2-2a16-4786-9188-cbeb6703fad5 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:11.703757 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b4d17af2-2a16-4786-9188-cbeb6703fad5 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:11.712008 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b4d17af2-2a16-4786-9188-cbeb6703fad5 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.158166 May 25 16:18:11.712555 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 480/972] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:11 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:12.733601 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-7ec66250-01fc-4eee-a124-f8242967016e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:12.734749 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-7ec66250-01fc-4eee-a124-f8242967016e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:12.742263 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7ec66250-01fc-4eee-a124-f8242967016e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:12.742706 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7ec66250-01fc-4eee-a124-f8242967016e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:12.743460 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7ec66250-01fc-4eee-a124-f8242967016e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:12.743915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-7ec66250-01fc-4eee-a124-f8242967016e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:12.877113 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-7ec66250-01fc-4eee-a124-f8242967016e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:12.885141 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-7ec66250-01fc-4eee-a124-f8242967016e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.158380 May 25 16:18:12.885709 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 493/973] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:12 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:13.906214 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e183797f-e7d5-4b6b-8a53-e8e3e6f82117 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:13.907311 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e183797f-e7d5-4b6b-8a53-e8e3e6f82117 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:13.918505 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e183797f-e7d5-4b6b-8a53-e8e3e6f82117 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:13.919261 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e183797f-e7d5-4b6b-8a53-e8e3e6f82117 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:13.920548 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e183797f-e7d5-4b6b-8a53-e8e3e6f82117 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:13.921319 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e183797f-e7d5-4b6b-8a53-e8e3e6f82117 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:14.054081 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e183797f-e7d5-4b6b-8a53-e8e3e6f82117 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:14.062371 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e183797f-e7d5-4b6b-8a53-e8e3e6f82117 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.162796 May 25 16:18:14.062953 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 481/974] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:13 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:15.082635 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2b140451-ee3b-4abb-9c1c-1c956f37ba69 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:15.083744 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2b140451-ee3b-4abb-9c1c-1c956f37ba69 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:15.094441 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b140451-ee3b-4abb-9c1c-1c956f37ba69 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:15.095196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b140451-ee3b-4abb-9c1c-1c956f37ba69 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:15.096588 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b140451-ee3b-4abb-9c1c-1c956f37ba69 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:15.097024 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2b140451-ee3b-4abb-9c1c-1c956f37ba69 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:15.233223 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2b140451-ee3b-4abb-9c1c-1c956f37ba69 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:15.245268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2b140451-ee3b-4abb-9c1c-1c956f37ba69 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.168922 May 25 16:18:15.245986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 494/975] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:15 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:16.268699 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-728b9d2a-b145-4c21-bd91-29b0858044e4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:16.269303 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-728b9d2a-b145-4c21-bd91-29b0858044e4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:16.276515 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-728b9d2a-b145-4c21-bd91-29b0858044e4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:16.276978 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-728b9d2a-b145-4c21-bd91-29b0858044e4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:16.277767 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-728b9d2a-b145-4c21-bd91-29b0858044e4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:16.278217 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-728b9d2a-b145-4c21-bd91-29b0858044e4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:16.419580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-728b9d2a-b145-4c21-bd91-29b0858044e4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:16.428942 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-728b9d2a-b145-4c21-bd91-29b0858044e4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.166660 May 25 16:18:16.429532 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 482/976] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:16 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:17.447355 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-f763aa8e-d657-4957-9768-dc3b20649faf tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:17.447916 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-f763aa8e-d657-4957-9768-dc3b20649faf tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:17.455081 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f763aa8e-d657-4957-9768-dc3b20649faf tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:17.455543 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f763aa8e-d657-4957-9768-dc3b20649faf tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:17.456359 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f763aa8e-d657-4957-9768-dc3b20649faf tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:17.456796 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-f763aa8e-d657-4957-9768-dc3b20649faf tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:17.587986 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-f763aa8e-d657-4957-9768-dc3b20649faf tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:17.595843 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-f763aa8e-d657-4957-9768-dc3b20649faf tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.152724 May 25 16:18:17.596423 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 495/977] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:17 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:18.615964 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d5796c1d-5fdf-42c7-9a15-1683fd7017d1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:18.616712 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d5796c1d-5fdf-42c7-9a15-1683fd7017d1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:18.623638 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d5796c1d-5fdf-42c7-9a15-1683fd7017d1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:18.624166 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d5796c1d-5fdf-42c7-9a15-1683fd7017d1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:18.624980 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d5796c1d-5fdf-42c7-9a15-1683fd7017d1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:18.625439 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d5796c1d-5fdf-42c7-9a15-1683fd7017d1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:18.757587 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d5796c1d-5fdf-42c7-9a15-1683fd7017d1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:18.765192 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d5796c1d-5fdf-42c7-9a15-1683fd7017d1 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.154502 May 25 16:18:18.765765 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 483/978] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:18 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:19.785612 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c5b3f22d-4306-4f22-bd3f-a00ade31bc6d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:19.786215 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c5b3f22d-4306-4f22-bd3f-a00ade31bc6d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:19.793098 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c5b3f22d-4306-4f22-bd3f-a00ade31bc6d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:19.793545 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c5b3f22d-4306-4f22-bd3f-a00ade31bc6d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:19.794307 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c5b3f22d-4306-4f22-bd3f-a00ade31bc6d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:19.794833 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c5b3f22d-4306-4f22-bd3f-a00ade31bc6d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:19.942002 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c5b3f22d-4306-4f22-bd3f-a00ade31bc6d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:19.949825 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c5b3f22d-4306-4f22-bd3f-a00ade31bc6d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1507 microversion: 2.1 time: 0.170976 May 25 16:18:19.950393 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 496/979] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:19 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:19.967908 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-56209424-0b6b-4e95-ab66-9fe226627c7d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:18:19.968449 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-56209424-0b6b-4e95-ab66-9fe226627c7d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:19.975139 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-56209424-0b6b-4e95-ab66-9fe226627c7d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:19.975590 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-56209424-0b6b-4e95-ab66-9fe226627c7d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:19.976383 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-56209424-0b6b-4e95-ab66-9fe226627c7d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:19.976818 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-56209424-0b6b-4e95-ab66-9fe226627c7d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:20.116111 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-56209424-0b6b-4e95-ab66-9fe226627c7d tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "POST /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497/action" status: 202 len: 0 microversion: 2.1 time: 0.152189 May 25 16:18:20.116715 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 484/980] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:18:19 2022] POST /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 16:18:20.124852 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c304a161-b391-4f86-b76f-faf3302c5ff8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:20.125469 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c304a161-b391-4f86-b76f-faf3302c5ff8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:20.131890 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c304a161-b391-4f86-b76f-faf3302c5ff8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:20.132342 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c304a161-b391-4f86-b76f-faf3302c5ff8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:20.133105 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c304a161-b391-4f86-b76f-faf3302c5ff8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:20.133544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c304a161-b391-4f86-b76f-faf3302c5ff8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:20.286065 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-c304a161-b391-4f86-b76f-faf3302c5ff8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:20.298790 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c304a161-b391-4f86-b76f-faf3302c5ff8 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1515 microversion: 2.1 time: 0.177584 May 25 16:18:20.303228 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 497/981] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:20 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:21.319288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-bca83d4a-d5dd-46d2-a157-ef830949da1c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:21.320013 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-bca83d4a-d5dd-46d2-a157-ef830949da1c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:21.327315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bca83d4a-d5dd-46d2-a157-ef830949da1c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:21.327760 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bca83d4a-d5dd-46d2-a157-ef830949da1c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:21.328564 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bca83d4a-d5dd-46d2-a157-ef830949da1c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:21.329003 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-bca83d4a-d5dd-46d2-a157-ef830949da1c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:21.467668 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-bca83d4a-d5dd-46d2-a157-ef830949da1c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:21.475808 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-bca83d4a-d5dd-46d2-a157-ef830949da1c tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1517 microversion: 2.1 time: 0.162115 May 25 16:18:21.476420 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 485/982] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:21 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:22.494370 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ce62fe61-aabb-4c29-bb8a-cc75b4d0d8bc tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:22.494999 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ce62fe61-aabb-4c29-bb8a-cc75b4d0d8bc tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:22.502691 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ce62fe61-aabb-4c29-bb8a-cc75b4d0d8bc tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:22.503145 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ce62fe61-aabb-4c29-bb8a-cc75b4d0d8bc tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:22.504119 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ce62fe61-aabb-4c29-bb8a-cc75b4d0d8bc tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:22.504688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ce62fe61-aabb-4c29-bb8a-cc75b4d0d8bc tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:22.646467 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ce62fe61-aabb-4c29-bb8a-cc75b4d0d8bc tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:22.659689 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ce62fe61-aabb-4c29-bb8a-cc75b4d0d8bc tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1573 microversion: 2.1 time: 0.169235 May 25 16:18:22.660688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 498/983] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:22 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:22.667845 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-fde320f8-2296-4560-a393-fd3d65b6522c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-289554726"}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:18:22.668355 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-fde320f8-2296-4560-a393-fd3d65b6522c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:22.675414 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fde320f8-2296-4560-a393-fd3d65b6522c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:22.675866 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fde320f8-2296-4560-a393-fd3d65b6522c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:22.676638 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fde320f8-2296-4560-a393-fd3d65b6522c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:22.677064 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-fde320f8-2296-4560-a393-fd3d65b6522c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:22.804506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.network.security_group_api [None req-fde320f8-2296-4560-a393-fd3d65b6522c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Removing security group a861fe6b-ba0e-452a-84be-18c1567ae7ed from port 2b47afd8-0e10-4e55-91a9-ef22ee9101ab May 25 16:18:23.088990 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-4719471f-09c6-4c15-8da4-6c10761a95d6 req-b54e3a62-ad39-44ab-a6af-bea34807b8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17708ce9-98f7-4676-9cdd-242102969497", "name": "network-vif-unplugged", "status": "completed", "tag": "5aba6c27-f5a6-468a-851f-055752b5ce50"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:18:23.097424 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-4719471f-09c6-4c15-8da4-6c10761a95d6 req-b54e3a62-ad39-44ab-a6af-bea34807b8a0 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:23.098129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-4719471f-09c6-4c15-8da4-6c10761a95d6 req-b54e3a62-ad39-44ab-a6af-bea34807b8a0 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:23.109994 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-4719471f-09c6-4c15-8da4-6c10761a95d6 req-b54e3a62-ad39-44ab-a6af-bea34807b8a0 service nova] Creating event network-vif-unplugged:5aba6c27-f5a6-468a-851f-055752b5ce50 for instance 17708ce9-98f7-4676-9cdd-242102969497 on hv-cinder-84327 May 25 16:18:23.115368 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-4719471f-09c6-4c15-8da4-6c10761a95d6 req-b54e3a62-ad39-44ab-a6af-bea34807b8a0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030229 May 25 16:18:23.116248 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 499/984] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:18:23.210420 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-fde320f8-2296-4560-a393-fd3d65b6522c tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "POST /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/action" status: 202 len: 0 microversion: 2.1 time: 0.546581 May 25 16:18:23.214264 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 486/985] 10.222.0.85 () {60 vars in 1277 bytes} [Wed May 25 16:18:22 2022] POST /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:18:23.219597 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-2ab12719-c05d-43c6-8556-4220266828a6 req-a211acdd-4748-4ce4-aa6f-358451d4c59f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a92754-a025-44df-a288-dca82b81ecf8", "tag": "2b47afd8-0e10-4e55-91a9-ef22ee9101ab"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:18:23.228591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-2ab12719-c05d-43c6-8556-4220266828a6 req-a211acdd-4748-4ce4-aa6f-358451d4c59f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:23.229309 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-2ab12719-c05d-43c6-8556-4220266828a6 req-a211acdd-4748-4ce4-aa6f-358451d4c59f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:23.243885 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-2ab12719-c05d-43c6-8556-4220266828a6 req-a211acdd-4748-4ce4-aa6f-358451d4c59f service nova] Creating event network-changed:2b47afd8-0e10-4e55-91a9-ef22ee9101ab for instance d9a92754-a025-44df-a288-dca82b81ecf8 on hv-cinder-84327 May 25 16:18:23.249042 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-2ab12719-c05d-43c6-8556-4220266828a6 req-a211acdd-4748-4ce4-aa6f-358451d4c59f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033443 May 25 16:18:23.249946 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 500/986] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:18:23.677841 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-8f32923e-4e0d-45f1-a3e9-0f3f4291f972 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:23.678491 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-8f32923e-4e0d-45f1-a3e9-0f3f4291f972 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:23.685857 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f32923e-4e0d-45f1-a3e9-0f3f4291f972 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:23.686378 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f32923e-4e0d-45f1-a3e9-0f3f4291f972 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:23.687259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f32923e-4e0d-45f1-a3e9-0f3f4291f972 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:23.687807 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-8f32923e-4e0d-45f1-a3e9-0f3f4291f972 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:23.923214 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-8f32923e-4e0d-45f1-a3e9-0f3f4291f972 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:23.930963 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-8f32923e-4e0d-45f1-a3e9-0f3f4291f972 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1573 microversion: 2.1 time: 0.257880 May 25 16:18:23.931529 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 487/987] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:23 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1573 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:24.485700 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c6b0d1af-61af-4846-8cdb-b1e0e6161db5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:24.486269 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-c6b0d1af-61af-4846-8cdb-b1e0e6161db5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:24.492806 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c6b0d1af-61af-4846-8cdb-b1e0e6161db5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:24.493259 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c6b0d1af-61af-4846-8cdb-b1e0e6161db5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:24.494054 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c6b0d1af-61af-4846-8cdb-b1e0e6161db5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:24.494488 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-c6b0d1af-61af-4846-8cdb-b1e0e6161db5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:24.576035 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-c6b0d1af-61af-4846-8cdb-b1e0e6161db5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lazy-loading 'services' on Instance uuid d9a92754-a025-44df-a288-dca82b81ecf8 {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:18:24.650883 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c6b0d1af-61af-4846-8cdb-b1e0e6161db5 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments/4c6013f3-9a58-49e2-925b-9dd7d6754736" status: 202 len: 0 microversion: 2.1 time: 0.169845 May 25 16:18:24.651478 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 501/988] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:18:24 2022] DELETE /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments/4c6013f3-9a58-49e2-925b-9dd7d6754736 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:18:24.660339 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-841c3064-2998-4073-aa3c-5f0564c4b526 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:24.661500 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-841c3064-2998-4073-aa3c-5f0564c4b526 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:24.668717 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-841c3064-2998-4073-aa3c-5f0564c4b526 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:24.669285 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-841c3064-2998-4073-aa3c-5f0564c4b526 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:24.670143 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-841c3064-2998-4073-aa3c-5f0564c4b526 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:24.670685 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-841c3064-2998-4073-aa3c-5f0564c4b526 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:24.703360 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-841c3064-2998-4073-aa3c-5f0564c4b526 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047339 May 25 16:18:24.703954 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 488/989] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:18:24 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:18:24.948893 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8ae63fa3-dfed-4b42-a11b-56a00d266b56 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:24.949615 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8ae63fa3-dfed-4b42-a11b-56a00d266b56 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:24.956731 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ae63fa3-dfed-4b42-a11b-56a00d266b56 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:24.957189 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ae63fa3-dfed-4b42-a11b-56a00d266b56 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:24.957999 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ae63fa3-dfed-4b42-a11b-56a00d266b56 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:24.958437 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8ae63fa3-dfed-4b42-a11b-56a00d266b56 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:25.100363 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-8ae63fa3-dfed-4b42-a11b-56a00d266b56 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:25.109922 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8ae63fa3-dfed-4b42-a11b-56a00d266b56 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1573 microversion: 2.1 time: 0.165361 May 25 16:18:25.114178 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 502/990] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:24 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:25.271347 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-ed65b4c9-f38e-49fd-b98e-7f9f6a8bb0e8 req-14513e3a-cc03-4151-90e4-5554016f7e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a92754-a025-44df-a288-dca82b81ecf8", "tag": "2b47afd8-0e10-4e55-91a9-ef22ee9101ab"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:18:25.280289 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-ed65b4c9-f38e-49fd-b98e-7f9f6a8bb0e8 req-14513e3a-cc03-4151-90e4-5554016f7e86 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:25.280715 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-ed65b4c9-f38e-49fd-b98e-7f9f6a8bb0e8 req-14513e3a-cc03-4151-90e4-5554016f7e86 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:25.293949 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-ed65b4c9-f38e-49fd-b98e-7f9f6a8bb0e8 req-14513e3a-cc03-4151-90e4-5554016f7e86 service nova] Creating event network-changed:2b47afd8-0e10-4e55-91a9-ef22ee9101ab for instance d9a92754-a025-44df-a288-dca82b81ecf8 on hv-cinder-84327 May 25 16:18:25.299605 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-ed65b4c9-f38e-49fd-b98e-7f9f6a8bb0e8 req-14513e3a-cc03-4151-90e4-5554016f7e86 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032249 May 25 16:18:25.300608 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 489/991] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:18:25.715775 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4c39a0ca-7e93-444c-ad14-6ca488b1c620 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:25.716858 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4c39a0ca-7e93-444c-ad14-6ca488b1c620 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:25.724507 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4c39a0ca-7e93-444c-ad14-6ca488b1c620 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:25.724958 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4c39a0ca-7e93-444c-ad14-6ca488b1c620 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:25.725698 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4c39a0ca-7e93-444c-ad14-6ca488b1c620 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:25.726152 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4c39a0ca-7e93-444c-ad14-6ca488b1c620 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:25.756328 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4c39a0ca-7e93-444c-ad14-6ca488b1c620 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044800 May 25 16:18:25.756863 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 503/992] 10.222.0.85 () {58 vars in 1301 bytes} [Wed May 25 16:18:25 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 16:18:25.768019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:25.768576 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:25.775044 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:25.775501 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:25.776303 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:25.776951 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:25.853731 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] HTTP exception thrown: Instance d9a92754-a025-44df-a288-dca82b81ecf8 is not attached to volume 4c6013f3-9a58-49e2-925b-9dd7d6754736 May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Request method failure captured: May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: DELETE /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments/4c6013f3-9a58-49e2-925b-9dd7d6754736 HTTP/1.1 May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlZTu-wyT0iGvdqhxa2TVe2AvF8DlJhhNMjLXKyk06buZ2RX48jMHHNTR0InVyaXBO607Hfl7dNNEDTDejckobGq2OMSeuehaODS9ZBbyRoMbr1f62YDGPqC5h67viO_spdrjjCJxJVVl42oHFiNb8tFVEOGNjNOIf6O6N7vU-MnKas May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: e2fbd40b4ea447319a8b90656548da9e May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-TestMinimumBasicScenario-1698562688 May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:18:25.856098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e2fbd40b4ea447319a8b90656548da9e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2fbd40b4ea447319a8b90656548da9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e2fbd40b4ea447319a8b90656548da9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2fbd40b4ea447319a8b90656548da9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-TestMinimumBasicScenario-1698562688 May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: e2fbd40b4ea447319a8b90656548da9e May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1698562688 May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-TestMinimumBasicScenario-1698562688-project May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 920a00aa201143f6ae4799aff51c6dae May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-TestMinimumBasicScenario-1698562688-project May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:18:25.857620 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance d9a92754-a025-44df-a288-dca82b81ecf8 is not attached to volume 4c6013f3-9a58-49e2-925b-9dd7d6754736 May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'server_id': 'd9a92754-a025-44df-a288-dca82b81ecf8', 'id': '4c6013f3-9a58-49e2-925b-9dd7d6754736'} May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4c6013f3-9a58-49e2-925b-9dd7d6754736. May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:18:25.858480 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a92754-a025-44df-a288-dca82b81ecf8 is not attached to volume 4c6013f3-9a58-49e2-925b-9dd7d6754736 May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a92754-a025-44df-a288-dca82b81ecf8 is not attached to volume 4c6013f3-9a58-49e2-925b-9dd7d6754736 May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:25.859901 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Returning 404 to user: Instance d9a92754-a025-44df-a288-dca82b81ecf8 is not attached to volume 4c6013f3-9a58-49e2-925b-9dd7d6754736 {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:18:25.860961 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-51be8158-8f15-405e-9a2f-71195c1d82a6 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments/4c6013f3-9a58-49e2-925b-9dd7d6754736" status: 404 len: 154 microversion: 2.1 time: 0.094496 May 25 16:18:25.860961 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 490/993] 10.222.0.85 () {58 vars in 1415 bytes} [Wed May 25 16:18:25 2022] DELETE /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8/os-volume_attachments/4c6013f3-9a58-49e2-925b-9dd7d6754736 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:18:26.129393 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-8cbb5606-b4e8-489d-b3ba-f774c2bfb29e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:26.130121 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-8cbb5606-b4e8-489d-b3ba-f774c2bfb29e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:26.137002 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8cbb5606-b4e8-489d-b3ba-f774c2bfb29e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:26.137441 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8cbb5606-b4e8-489d-b3ba-f774c2bfb29e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:26.138207 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8cbb5606-b4e8-489d-b3ba-f774c2bfb29e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:26.138658 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-8cbb5606-b4e8-489d-b3ba-f774c2bfb29e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:26.282312 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-8cbb5606-b4e8-489d-b3ba-f774c2bfb29e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:26.290637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-8cbb5606-b4e8-489d-b3ba-f774c2bfb29e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1573 microversion: 2.1 time: 0.165403 May 25 16:18:26.291216 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 504/994] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:26 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:27.004142 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-3de55122-e9dc-4f77-8e95-7adebe4bfafd tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:27.004644 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3de55122-e9dc-4f77-8e95-7adebe4bfafd tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:27.011692 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3de55122-e9dc-4f77-8e95-7adebe4bfafd tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:27.012191 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3de55122-e9dc-4f77-8e95-7adebe4bfafd tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:27.012958 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3de55122-e9dc-4f77-8e95-7adebe4bfafd tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:27.013390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-3de55122-e9dc-4f77-8e95-7adebe4bfafd tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:27.038740 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-3de55122-e9dc-4f77-8e95-7adebe4bfafd tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Going to try to terminate instance {{(pid=117763) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:18:27.126497 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-3de55122-e9dc-4f77-8e95-7adebe4bfafd tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 204 len: 0 microversion: 2.1 time: 0.125942 May 25 16:18:27.127144 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 491/995] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:18:26 2022] DELETE /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:18:27.136276 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-fb42b48c-f1e1-4aa0-9cba-380c7c061d8b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:27.136974 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-fb42b48c-f1e1-4aa0-9cba-380c7c061d8b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:27.143922 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fb42b48c-f1e1-4aa0-9cba-380c7c061d8b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:27.144371 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fb42b48c-f1e1-4aa0-9cba-380c7c061d8b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:27.145135 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fb42b48c-f1e1-4aa0-9cba-380c7c061d8b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:27.145567 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fb42b48c-f1e1-4aa0-9cba-380c7c061d8b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:27.149640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:27.282034 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-fb42b48c-f1e1-4aa0-9cba-380c7c061d8b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:27.289953 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-fb42b48c-f1e1-4aa0-9cba-380c7c061d8b tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1554 microversion: 2.1 time: 0.158387 May 25 16:18:27.290526 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 505/996] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:27 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:27.311882 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e11dccac-0407-4e09-8e59-7c282f43e02a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:27.312908 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e11dccac-0407-4e09-8e59-7c282f43e02a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:27.321107 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e11dccac-0407-4e09-8e59-7c282f43e02a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:27.321558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e11dccac-0407-4e09-8e59-7c282f43e02a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:27.322331 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e11dccac-0407-4e09-8e59-7c282f43e02a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:27.322768 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e11dccac-0407-4e09-8e59-7c282f43e02a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:27.465402 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e11dccac-0407-4e09-8e59-7c282f43e02a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:27.470522 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:27.477245 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e11dccac-0407-4e09-8e59-7c282f43e02a tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1573 microversion: 2.1 time: 0.171773 May 25 16:18:27.477949 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 492/997] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:27 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:28.308155 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-3ea51b7b-1b91-4e1c-b21e-b03d263edf5a tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:28.308744 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-3ea51b7b-1b91-4e1c-b21e-b03d263edf5a tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:28.315703 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3ea51b7b-1b91-4e1c-b21e-b03d263edf5a tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:28.316193 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3ea51b7b-1b91-4e1c-b21e-b03d263edf5a tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:28.316943 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3ea51b7b-1b91-4e1c-b21e-b03d263edf5a tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:28.317369 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-3ea51b7b-1b91-4e1c-b21e-b03d263edf5a tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:28.456637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-3ea51b7b-1b91-4e1c-b21e-b03d263edf5a tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:28.464580 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-3ea51b7b-1b91-4e1c-b21e-b03d263edf5a tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1554 microversion: 2.1 time: 0.160359 May 25 16:18:28.465146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 506/998] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:28 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:28.498961 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-22408fe4-4ed6-4092-9d17-ba43819b2320 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:28.499570 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-22408fe4-4ed6-4092-9d17-ba43819b2320 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:28.507439 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-22408fe4-4ed6-4092-9d17-ba43819b2320 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:28.507920 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-22408fe4-4ed6-4092-9d17-ba43819b2320 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:28.508688 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-22408fe4-4ed6-4092-9d17-ba43819b2320 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:28.509128 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-22408fe4-4ed6-4092-9d17-ba43819b2320 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:28.658665 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-22408fe4-4ed6-4092-9d17-ba43819b2320 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:28.666947 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-22408fe4-4ed6-4092-9d17-ba43819b2320 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1573 microversion: 2.1 time: 0.172187 May 25 16:18:28.667521 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 493/999] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:28 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:29.484452 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b80dd458-9108-43e1-a992-68265571a456 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:29.485022 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b80dd458-9108-43e1-a992-68265571a456 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:29.493342 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b80dd458-9108-43e1-a992-68265571a456 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:29.493894 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b80dd458-9108-43e1-a992-68265571a456 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:29.494841 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b80dd458-9108-43e1-a992-68265571a456 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:29.495394 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b80dd458-9108-43e1-a992-68265571a456 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:29.684573 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1744e5b0-41d4-4238-bf84-d648df2ddcc0 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:29.685278 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1744e5b0-41d4-4238-bf84-d648df2ddcc0 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:29.692393 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1744e5b0-41d4-4238-bf84-d648df2ddcc0 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:29.692847 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1744e5b0-41d4-4238-bf84-d648df2ddcc0 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:29.694298 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1744e5b0-41d4-4238-bf84-d648df2ddcc0 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:29.694741 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1744e5b0-41d4-4238-bf84-d648df2ddcc0 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:29.765544 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b80dd458-9108-43e1-a992-68265571a456 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:29.773123 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b80dd458-9108-43e1-a992-68265571a456 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1554 microversion: 2.1 time: 0.293833 May 25 16:18:29.773947 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 507/1000] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:29 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1554 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:29.833547 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1744e5b0-41d4-4238-bf84-d648df2ddcc0 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:29.841455 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1744e5b0-41d4-4238-bf84-d648df2ddcc0 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1573 microversion: 2.1 time: 0.160885 May 25 16:18:29.842007 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 494/1001] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:29 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:30.205502 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-8052d0b9-df01-4a1c-97b7-5a081ddfdaf5 req-ea7129fe-8fe5-456f-a727-0ff89648451f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a92754-a025-44df-a288-dca82b81ecf8", "name": "network-vif-deleted", "tag": "2b47afd8-0e10-4e55-91a9-ef22ee9101ab"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:18:30.214300 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-8052d0b9-df01-4a1c-97b7-5a081ddfdaf5 req-ea7129fe-8fe5-456f-a727-0ff89648451f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:30.214784 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-8052d0b9-df01-4a1c-97b7-5a081ddfdaf5 req-ea7129fe-8fe5-456f-a727-0ff89648451f service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:30.226600 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-8052d0b9-df01-4a1c-97b7-5a081ddfdaf5 req-ea7129fe-8fe5-456f-a727-0ff89648451f service nova] Creating event network-vif-deleted:2b47afd8-0e10-4e55-91a9-ef22ee9101ab for instance d9a92754-a025-44df-a288-dca82b81ecf8 on hv-cinder-84327 May 25 16:18:30.231698 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-8052d0b9-df01-4a1c-97b7-5a081ddfdaf5 req-ea7129fe-8fe5-456f-a727-0ff89648451f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093353 May 25 16:18:30.232400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 508/1002] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:18:30.793049 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:30.793657 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:30.801318 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:30.801792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:30.802592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:30.803030 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:30.835342 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:30.835722 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:30.836223 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.objects.instance [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lazy-loading 'fault' on Instance uuid d9a92754-a025-44df-a288-dca82b81ecf8 {{(pid=117763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:18:30.873389 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-4e5e63d5-2689-400c-a905-f6c7f4695495 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:30.874152 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-4e5e63d5-2689-400c-a905-f6c7f4695495 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:30.881166 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920a00aa201143f6ae4799aff51c6dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fbd40b4ea447319a8b90656548da9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:30.881949 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e5e63d5-2689-400c-a905-f6c7f4695495 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:30.882400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e5e63d5-2689-400c-a905-f6c7f4695495 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:30.883584 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e5e63d5-2689-400c-a905-f6c7f4695495 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:30.884229 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-4e5e63d5-2689-400c-a905-f6c7f4695495 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:30.889205 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-b015df39-8fd3-4d17-9949-0d2855e241e0 tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 200 len: 1348 microversion: 2.1 time: 0.101054 May 25 16:18:30.896391 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 495/1003] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:30 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 1348 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:31.024050 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-4e5e63d5-2689-400c-a905-f6c7f4695495 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:31.034247 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-4e5e63d5-2689-400c-a905-f6c7f4695495 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1573 microversion: 2.1 time: 0.177958 May 25 16:18:31.034869 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 509/1004] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:30 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:31.910595 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:31.911959 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] [instance: d9a92754-a025-44df-a288-dca82b81ecf8] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:31.923122 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:31.923902 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:31.925182 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:31.925906 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:31.941374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] HTTP exception thrown: Instance d9a92754-a025-44df-a288-dca82b81ecf8 could not be found. May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Request method failure captured: May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 HTTP/1.1 May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlZTu-wyT0iGvdqhxa2TVe2AvF8DlJhhNMjLXKyk06buZ2RX48jMHHNTR0InVyaXBO607Hfl7dNNEDTDejckobGq2OMSeuehaODS9ZBbyRoMbr1f62YDGPqC5h67viO_spdrjjCJxJVVl42oHFiNb8tFVEOGNjNOIf6O6N7vU-MnKas May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: e2fbd40b4ea447319a8b90656548da9e May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-TestMinimumBasicScenario-1698562688 May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:18:31.943157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e2fbd40b4ea447319a8b90656548da9e", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2fbd40b4ea447319a8b90656548da9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e2fbd40b4ea447319a8b90656548da9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e2fbd40b4ea447319a8b90656548da9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-TestMinimumBasicScenario-1698562688 May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: e2fbd40b4ea447319a8b90656548da9e May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1698562688 May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-TestMinimumBasicScenario-1698562688-project May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 920a00aa201143f6ae4799aff51c6dae May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-TestMinimumBasicScenario-1698562688-project May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance d9a92754-a025-44df-a288-dca82b81ecf8 could not be found. May 25 16:18:31.944886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': 'd9a92754-a025-44df-a288-dca82b81ecf8'} May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a92754-a025-44df-a288-dca82b81ecf8 could not be found. May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:18:31.945869 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a92754-a025-44df-a288-dca82b81ecf8 could not be found. May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a92754-a025-44df-a288-dca82b81ecf8 could not be found. May 25 16:18:31.947506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:18:31.949118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Returning 404 to user: Instance d9a92754-a025-44df-a288-dca82b81ecf8 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:18:31.949118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-56cedbba-8278-485d-9ce6-b3267234a18e tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8" status: 404 len: 111 microversion: 2.1 time: 0.040557 May 25 16:18:31.949118 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 496/1005] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:31 2022] GET /compute/v2.1/servers/d9a92754-a025-44df-a288-dca82b81ecf8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:18:31.953808 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-fc3f005d-d824-4787-82c4-6b756ee4b2bf tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] Calling method '.version_select at 0x7fbaf0128040>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:31.974136 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-fc3f005d-d824-4787-82c4-6b756ee4b2bf tempest-TestMinimumBasicScenario-1698562688 tempest-TestMinimumBasicScenario-1698562688-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-845424343" status: 202 len: 0 microversion: 2.1 time: 0.024261 May 25 16:18:31.974696 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 510/1006] 10.222.0.85 () {58 vars in 1268 bytes} [Wed May 25 16:18:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-845424343 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:18:32.051330 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-84aaacf6-7d5b-4fa0-9d18-a5ea91b8b329 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:18:32.051970 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-84aaacf6-7d5b-4fa0-9d18-a5ea91b8b329 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:18:32.058061 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-84aaacf6-7d5b-4fa0-9d18-a5ea91b8b329 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:32.058408 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-84aaacf6-7d5b-4fa0-9d18-a5ea91b8b329 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:32.059148 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-84aaacf6-7d5b-4fa0-9d18-a5ea91b8b329 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:32.059580 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-84aaacf6-7d5b-4fa0-9d18-a5ea91b8b329 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:32.195593 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-84aaacf6-7d5b-4fa0-9d18-a5ea91b8b329 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:18:32.203599 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-84aaacf6-7d5b-4fa0-9d18-a5ea91b8b329 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1560 microversion: 2.1 time: 0.156120 May 25 16:18:32.204238 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 497/1007] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:18:32 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:18:33.272328 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-b17525f0-81d0-43cd-9338-624a27ac325d req-43bcaf05-624b-4c9b-80ca-732e0923d640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17708ce9-98f7-4676-9cdd-242102969497", "name": "network-vif-plugged", "status": "completed", "tag": "5aba6c27-f5a6-468a-851f-055752b5ce50"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:18:33.281834 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-b17525f0-81d0-43cd-9338-624a27ac325d req-43bcaf05-624b-4c9b-80ca-732e0923d640 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:18:33.282305 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-b17525f0-81d0-43cd-9338-624a27ac325d req-43bcaf05-624b-4c9b-80ca-732e0923d640 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:18:33.301866 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-b17525f0-81d0-43cd-9338-624a27ac325d req-43bcaf05-624b-4c9b-80ca-732e0923d640 service nova] Creating event network-vif-plugged:5aba6c27-f5a6-468a-851f-055752b5ce50 for instance 17708ce9-98f7-4676-9cdd-242102969497 on hv-cinder-84327 May 25 16:18:33.307654 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-b17525f0-81d0-43cd-9338-624a27ac325d req-43bcaf05-624b-4c9b-80ca-732e0923d640 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102946 May 25 16:18:33.308296 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 511/1008] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 16:19:23.520592 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c4dc4921-570d-4caa-821f-54f2b8c8dd05 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:23.521207 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c4dc4921-570d-4caa-821f-54f2b8c8dd05 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:23.523543 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:23.524228 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=28 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:23.531187 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c4dc4921-570d-4caa-821f-54f2b8c8dd05 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:23.531646 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c4dc4921-570d-4caa-821f-54f2b8c8dd05 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:23.532446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c4dc4921-570d-4caa-821f-54f2b8c8dd05 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:23.532886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c4dc4921-570d-4caa-821f-54f2b8c8dd05 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:23.558829 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c4dc4921-570d-4caa-821f-54f2b8c8dd05 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Going to try to terminate instance {{(pid=117763) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:19:23.638667 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c4dc4921-570d-4caa-821f-54f2b8c8dd05 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "DELETE /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 204 len: 0 microversion: 2.1 time: 0.124368 May 25 16:19:23.639289 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 498/1009] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:19:23 2022] DELETE /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:19:23.646505 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:23.647263 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=26 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:23.652937 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-1ed7263e-285d-401b-ae84-da0f18a932db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:23.653949 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-1ed7263e-285d-401b-ae84-da0f18a932db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:23.663476 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1ed7263e-285d-401b-ae84-da0f18a932db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:23.663949 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1ed7263e-285d-401b-ae84-da0f18a932db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:23.664715 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1ed7263e-285d-401b-ae84-da0f18a932db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:23.665150 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-1ed7263e-285d-401b-ae84-da0f18a932db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:23.814887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-1ed7263e-285d-401b-ae84-da0f18a932db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:23.823120 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-1ed7263e-285d-401b-ae84-da0f18a932db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1579 microversion: 2.1 time: 0.178975 May 25 16:19:23.823693 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 512/1010] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:23 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:24.851911 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a6204d77-6894-40ae-af34-a4ec72363fc2 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:24.853091 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a6204d77-6894-40ae-af34-a4ec72363fc2 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:24.864348 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a6204d77-6894-40ae-af34-a4ec72363fc2 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:24.864801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a6204d77-6894-40ae-af34-a4ec72363fc2 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:24.865575 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a6204d77-6894-40ae-af34-a4ec72363fc2 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:24.866016 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a6204d77-6894-40ae-af34-a4ec72363fc2 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:25.017340 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a6204d77-6894-40ae-af34-a4ec72363fc2 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:25.025714 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a6204d77-6894-40ae-af34-a4ec72363fc2 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1579 microversion: 2.1 time: 0.181608 May 25 16:19:25.026259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 499/1011] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:24 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1579 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:26.043011 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-fe7a2aea-9b76-45f9-932c-18925e7c4a8f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:26.043656 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-fe7a2aea-9b76-45f9-932c-18925e7c4a8f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:26.053358 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fe7a2aea-9b76-45f9-932c-18925e7c4a8f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:26.053797 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fe7a2aea-9b76-45f9-932c-18925e7c4a8f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:26.054688 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fe7a2aea-9b76-45f9-932c-18925e7c4a8f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:26.055434 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-fe7a2aea-9b76-45f9-932c-18925e7c4a8f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:26.116913 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-88c1b2e2-0618-4eb7-a461-cca5d608a9d2 req-4d942a64-ee51-4aec-bcb8-6c092cf8cd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c", "name": "network-vif-deleted", "tag": "df8efe81-4270-4002-990c-7c522f23f381"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:19:26.129556 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-88c1b2e2-0618-4eb7-a461-cca5d608a9d2 req-4d942a64-ee51-4aec-bcb8-6c092cf8cd20 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:26.130046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-88c1b2e2-0618-4eb7-a461-cca5d608a9d2 req-4d942a64-ee51-4aec-bcb8-6c092cf8cd20 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:26.141800 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-fe7a2aea-9b76-45f9-932c-18925e7c4a8f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:26.147149 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-88c1b2e2-0618-4eb7-a461-cca5d608a9d2 req-4d942a64-ee51-4aec-bcb8-6c092cf8cd20 service nova] Creating event network-vif-deleted:df8efe81-4270-4002-990c-7c522f23f381 for instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c on hv-cinder-84327 May 25 16:19:26.153583 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-88c1b2e2-0618-4eb7-a461-cca5d608a9d2 req-4d942a64-ee51-4aec-bcb8-6c092cf8cd20 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041248 May 25 16:19:26.156151 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-fe7a2aea-9b76-45f9-932c-18925e7c4a8f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 200 len: 1511 microversion: 2.1 time: 0.117090 May 25 16:19:26.157034 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 513/1012] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:26 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 1511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:26.158893 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 500/1013] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:19:27.174434 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:27.175078 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:27.181891 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:27.182347 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:27.183112 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:27.183567 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:27.198184 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] HTTP exception thrown: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Request method failure captured: May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c HTTP/1.1 May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlZl2_U5qisNuCZ7wOi3t3AeRSjnU62DNT2AZcREFByH_xap352TyZiLaW5m5MykjOI5s61d4tX2M34Nmyi0pFX5qGH4VMqqjBU48_DJEwIIbcWjUwAS9kgDB_m3L9Lrs88hRILAYNEo3uvkCJDuQn32MVw_5XutcnCBF82vkVLybL0 May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:19:27.199865 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_31462b97f7a04859b66398fd6386cfc4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-TestVolumeBootPattern-1806662121 May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-TestVolumeBootPattern-1806662121-project May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 67b7bca2e2ef4dbf89554ba2f9bf93e5 May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-TestVolumeBootPattern-1806662121-project May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:19:27.201628 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c'} May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:19:27.202518 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:19:27.203941 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:19:27.205167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Returning 404 to user: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:19:27.205167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-53f62c58-cc97-4880-8af0-f2cabcfd3595 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 404 len: 111 microversion: 2.1 time: 0.031049 May 25 16:19:27.205167 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 514/1014] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:27 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:19:27.298443 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1368593730", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1131416181", "security_groups": [{"name": "tempest-secgroup-smoke-1645907198"}], "block_device_mapping_v2": [{"uuid": "94421079-9e65-40cb-abb2-eab8c42dd3c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8835a77f-3e24-453e-9279-13b9fbf47bf1"}]}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:19:27.420301 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] validate_networks() for [('8835a77f-3e24-453e-9279-13b9fbf47bf1', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:19:27.795386 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:19:27.795839 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:19:27.796362 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:19:27.796770 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:19:27.797176 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:19:27.807018 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:27.807466 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:27.808275 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:27.808706 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:27.825853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Getting quotas for project 31462b97f7a04859b66398fd6386cfc4. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:19:27.830069 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Getting quotas for user 67b7bca2e2ef4dbf89554ba2f9bf93e5 and project 31462b97f7a04859b66398fd6386cfc4. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:19:27.895174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:19:27.897506 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94421079-9e65-40cb-abb2-eab8c42dd3c6',volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:19:28.028252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-696a92f6-d894-4631-afa5-dd29236877eb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734816 May 25 16:19:28.028898 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 501/1015] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:19:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:19:28.039274 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-091015a0-1b91-4abd-967d-408b61a3eb50 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:28.040196 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-091015a0-1b91-4abd-967d-408b61a3eb50 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:28.096091 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-091015a0-1b91-4abd-967d-408b61a3eb50 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:28.103243 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-091015a0-1b91-4abd-967d-408b61a3eb50 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1095 microversion: 2.1 time: 0.067927 May 25 16:19:28.103887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 515/1016] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:28 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:29.120478 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-12a3b04e-7529-4030-917c-d1a41aeb195d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:29.121090 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-12a3b04e-7529-4030-917c-d1a41aeb195d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:29.128692 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-12a3b04e-7529-4030-917c-d1a41aeb195d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:29.129145 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-12a3b04e-7529-4030-917c-d1a41aeb195d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:29.130038 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-12a3b04e-7529-4030-917c-d1a41aeb195d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:29.130467 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-12a3b04e-7529-4030-917c-d1a41aeb195d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:29.195803 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-12a3b04e-7529-4030-917c-d1a41aeb195d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:29.203322 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-12a3b04e-7529-4030-917c-d1a41aeb195d tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1211 microversion: 2.1 time: 0.086682 May 25 16:19:29.203945 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 502/1017] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:29 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:30.220612 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-59485b7d-5e29-44c9-b34e-231da6f6c203 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:30.221566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-59485b7d-5e29-44c9-b34e-231da6f6c203 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:30.229906 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-59485b7d-5e29-44c9-b34e-231da6f6c203 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:30.230694 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-59485b7d-5e29-44c9-b34e-231da6f6c203 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:30.231549 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-59485b7d-5e29-44c9-b34e-231da6f6c203 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:30.232193 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-59485b7d-5e29-44c9-b34e-231da6f6c203 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:30.392960 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-814d56a9-6240-4151-928e-c692aada1d7e req-f491affb-b20a-4182-adc0-4aaadaa3dc3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539efdcc-6973-43c1-a734-92c87b922e4e", "tag": "5264fc9c-9b67-46b8-b243-fb98e7e2afe8"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:19:30.406161 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-814d56a9-6240-4151-928e-c692aada1d7e req-f491affb-b20a-4182-adc0-4aaadaa3dc3c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:30.406714 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-814d56a9-6240-4151-928e-c692aada1d7e req-f491affb-b20a-4182-adc0-4aaadaa3dc3c service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:30.420349 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-814d56a9-6240-4151-928e-c692aada1d7e req-f491affb-b20a-4182-adc0-4aaadaa3dc3c service nova] Creating event network-changed:5264fc9c-9b67-46b8-b243-fb98e7e2afe8 for instance 539efdcc-6973-43c1-a734-92c87b922e4e on hv-cinder-84327 May 25 16:19:30.426581 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-814d56a9-6240-4151-928e-c692aada1d7e req-f491affb-b20a-4182-adc0-4aaadaa3dc3c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037276 May 25 16:19:30.427337 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 503/1018] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:19:30.729485 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-59485b7d-5e29-44c9-b34e-231da6f6c203 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:30.737233 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-59485b7d-5e29-44c9-b34e-231da6f6c203 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.520974 May 25 16:19:30.737803 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 516/1019] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:30 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:31.755184 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a8b8dea7-b86d-4dfe-9763-ff7419588218 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:31.756019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a8b8dea7-b86d-4dfe-9763-ff7419588218 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:31.762910 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a8b8dea7-b86d-4dfe-9763-ff7419588218 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:31.763435 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a8b8dea7-b86d-4dfe-9763-ff7419588218 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:31.764315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a8b8dea7-b86d-4dfe-9763-ff7419588218 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:31.764826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a8b8dea7-b86d-4dfe-9763-ff7419588218 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:31.897680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a8b8dea7-b86d-4dfe-9763-ff7419588218 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:31.908773 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a8b8dea7-b86d-4dfe-9763-ff7419588218 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.157753 May 25 16:19:31.909342 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 504/1020] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:31 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:32.927227 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-2f830536-9873-48f9-9bd2-f2d3e31a96d3 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:32.927853 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-2f830536-9873-48f9-9bd2-f2d3e31a96d3 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:32.934546 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f830536-9873-48f9-9bd2-f2d3e31a96d3 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:32.934992 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f830536-9873-48f9-9bd2-f2d3e31a96d3 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:32.935736 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f830536-9873-48f9-9bd2-f2d3e31a96d3 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:32.936204 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-2f830536-9873-48f9-9bd2-f2d3e31a96d3 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:33.080618 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-2f830536-9873-48f9-9bd2-f2d3e31a96d3 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:33.088569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-2f830536-9873-48f9-9bd2-f2d3e31a96d3 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.165481 May 25 16:19:33.089133 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 517/1021] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:32 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:34.109846 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d3345608-53cd-4ed5-9a57-6af9ce5ecfa7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:34.110876 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d3345608-53cd-4ed5-9a57-6af9ce5ecfa7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:34.121990 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3345608-53cd-4ed5-9a57-6af9ce5ecfa7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:34.122742 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3345608-53cd-4ed5-9a57-6af9ce5ecfa7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:34.124116 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3345608-53cd-4ed5-9a57-6af9ce5ecfa7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:34.124851 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3345608-53cd-4ed5-9a57-6af9ce5ecfa7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:34.264494 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-d3345608-53cd-4ed5-9a57-6af9ce5ecfa7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:34.275479 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d3345608-53cd-4ed5-9a57-6af9ce5ecfa7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.171911 May 25 16:19:34.276295 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 505/1022] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:34 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:35.301116 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-10dd37cd-accf-419c-9436-6e4f8b4b28d1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:35.302554 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-10dd37cd-accf-419c-9436-6e4f8b4b28d1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:35.309726 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10dd37cd-accf-419c-9436-6e4f8b4b28d1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:35.310182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10dd37cd-accf-419c-9436-6e4f8b4b28d1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:35.310956 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10dd37cd-accf-419c-9436-6e4f8b4b28d1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:35.311392 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-10dd37cd-accf-419c-9436-6e4f8b4b28d1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:35.442525 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-10dd37cd-accf-419c-9436-6e4f8b4b28d1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:35.450312 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-10dd37cd-accf-419c-9436-6e4f8b4b28d1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.156414 May 25 16:19:35.451048 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 518/1023] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:35 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:35.725264 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:19:35.725674 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Wed May 25 16:19:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:19:36.474858 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-38352e91-3fc6-46e2-b0a4-afded3b48058 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:36.475545 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-38352e91-3fc6-46e2-b0a4-afded3b48058 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:36.482179 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-38352e91-3fc6-46e2-b0a4-afded3b48058 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:36.482643 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-38352e91-3fc6-46e2-b0a4-afded3b48058 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:36.483436 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-38352e91-3fc6-46e2-b0a4-afded3b48058 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:36.483894 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-38352e91-3fc6-46e2-b0a4-afded3b48058 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:36.619259 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-38352e91-3fc6-46e2-b0a4-afded3b48058 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:36.627004 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-38352e91-3fc6-46e2-b0a4-afded3b48058 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.159049 May 25 16:19:36.627574 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 506/1024] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:36 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:37.646789 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-67b666eb-df76-4466-b736-3c75940248f8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:37.647427 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-67b666eb-df76-4466-b736-3c75940248f8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:37.654765 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-67b666eb-df76-4466-b736-3c75940248f8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:37.655239 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-67b666eb-df76-4466-b736-3c75940248f8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:37.656079 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-67b666eb-df76-4466-b736-3c75940248f8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:37.656531 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-67b666eb-df76-4466-b736-3c75940248f8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:37.805469 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-67b666eb-df76-4466-b736-3c75940248f8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:37.813540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-67b666eb-df76-4466-b736-3c75940248f8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.172355 May 25 16:19:37.814098 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 519/1025] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:37 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:38.831001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-ce209a58-bdea-4f61-aaec-800da30be6ba tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:38.831548 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-ce209a58-bdea-4f61-aaec-800da30be6ba tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:38.834373 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:38.835134 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:38.841348 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce209a58-bdea-4f61-aaec-800da30be6ba tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:38.841801 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce209a58-bdea-4f61-aaec-800da30be6ba tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:38.842558 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce209a58-bdea-4f61-aaec-800da30be6ba tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:38.842994 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-ce209a58-bdea-4f61-aaec-800da30be6ba tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:38.980363 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-ce209a58-bdea-4f61-aaec-800da30be6ba tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:38.987935 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-ce209a58-bdea-4f61-aaec-800da30be6ba tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.160981 May 25 16:19:38.988512 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 507/1026] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:38 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:40.007475 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-555f254c-d3aa-41f7-a6aa-96ccbd43ae8e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:40.008185 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-555f254c-d3aa-41f7-a6aa-96ccbd43ae8e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:40.010780 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:40.019251 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-555f254c-d3aa-41f7-a6aa-96ccbd43ae8e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:40.019925 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-555f254c-d3aa-41f7-a6aa-96ccbd43ae8e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:40.021058 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-555f254c-d3aa-41f7-a6aa-96ccbd43ae8e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:40.021694 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-555f254c-d3aa-41f7-a6aa-96ccbd43ae8e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:40.158988 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-555f254c-d3aa-41f7-a6aa-96ccbd43ae8e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:40.166921 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-555f254c-d3aa-41f7-a6aa-96ccbd43ae8e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.165834 May 25 16:19:40.167478 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 520/1027] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:39 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:41.188891 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-876be8c2-8adb-48e8-9d16-bedef0793fbd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:41.189951 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-876be8c2-8adb-48e8-9d16-bedef0793fbd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:41.200983 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-876be8c2-8adb-48e8-9d16-bedef0793fbd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:41.201728 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-876be8c2-8adb-48e8-9d16-bedef0793fbd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:41.203005 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-876be8c2-8adb-48e8-9d16-bedef0793fbd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:41.203734 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-876be8c2-8adb-48e8-9d16-bedef0793fbd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:41.350367 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-876be8c2-8adb-48e8-9d16-bedef0793fbd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:41.359166 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-876be8c2-8adb-48e8-9d16-bedef0793fbd tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.176768 May 25 16:19:41.359765 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 508/1028] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:41 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:41.517799 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-74bf4d23-2108-4b21-b3fa-20d2568b6ddb req-f9391f0b-8bc7-4b16-aa16-a29c5afbbada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539efdcc-6973-43c1-a734-92c87b922e4e", "name": "network-vif-plugged", "status": "completed", "tag": "5264fc9c-9b67-46b8-b243-fb98e7e2afe8"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:19:41.527232 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-74bf4d23-2108-4b21-b3fa-20d2568b6ddb req-f9391f0b-8bc7-4b16-aa16-a29c5afbbada service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:41.527669 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-74bf4d23-2108-4b21-b3fa-20d2568b6ddb req-f9391f0b-8bc7-4b16-aa16-a29c5afbbada service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:41.541473 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-74bf4d23-2108-4b21-b3fa-20d2568b6ddb req-f9391f0b-8bc7-4b16-aa16-a29c5afbbada service nova] Creating event network-vif-plugged:5264fc9c-9b67-46b8-b243-fb98e7e2afe8 for instance 539efdcc-6973-43c1-a734-92c87b922e4e on hv-cinder-84327 May 25 16:19:41.546823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-74bf4d23-2108-4b21-b3fa-20d2568b6ddb req-f9391f0b-8bc7-4b16-aa16-a29c5afbbada service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032828 May 25 16:19:41.547637 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 521/1029] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:19:42.380411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9dd11186-3cd4-43fe-995e-642d5da2da80 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:42.381578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9dd11186-3cd4-43fe-995e-642d5da2da80 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:42.389438 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9dd11186-3cd4-43fe-995e-642d5da2da80 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:42.389956 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9dd11186-3cd4-43fe-995e-642d5da2da80 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:42.390874 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9dd11186-3cd4-43fe-995e-642d5da2da80 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:42.391412 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9dd11186-3cd4-43fe-995e-642d5da2da80 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:42.535001 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9dd11186-3cd4-43fe-995e-642d5da2da80 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:42.543190 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9dd11186-3cd4-43fe-995e-642d5da2da80 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1267 microversion: 2.1 time: 0.169336 May 25 16:19:42.543771 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 509/1030] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:42 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:43.565980 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-860db494-59db-448d-abb5-e7b3e94372e8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:43.567010 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-860db494-59db-448d-abb5-e7b3e94372e8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:43.578217 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-860db494-59db-448d-abb5-e7b3e94372e8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:43.578965 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-860db494-59db-448d-abb5-e7b3e94372e8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:43.580267 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-860db494-59db-448d-abb5-e7b3e94372e8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:43.580988 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-860db494-59db-448d-abb5-e7b3e94372e8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:43.725899 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-860db494-59db-448d-abb5-e7b3e94372e8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:43.737604 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-860db494-59db-448d-abb5-e7b3e94372e8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1454 microversion: 2.1 time: 0.178590 May 25 16:19:43.738431 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 522/1031] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:43 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:43.754411 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-a07599d3-2494-4a87-9b5d-90140b007f36 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:43.755002 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-a07599d3-2494-4a87-9b5d-90140b007f36 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:43.761982 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a07599d3-2494-4a87-9b5d-90140b007f36 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:43.762434 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a07599d3-2494-4a87-9b5d-90140b007f36 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:43.763202 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a07599d3-2494-4a87-9b5d-90140b007f36 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:43.763639 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-a07599d3-2494-4a87-9b5d-90140b007f36 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:43.909950 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-a07599d3-2494-4a87-9b5d-90140b007f36 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:43.917940 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-a07599d3-2494-4a87-9b5d-90140b007f36 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1454 microversion: 2.1 time: 0.167420 May 25 16:19:43.918517 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 510/1032] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:43 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:46.400108 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-8f42c40b-5862-4b61-ab89-f233fa000420 req-c0e1f092-4745-4fe8-b8a7-eb407f025803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539efdcc-6973-43c1-a734-92c87b922e4e", "tag": "5264fc9c-9b67-46b8-b243-fb98e7e2afe8"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:19:46.410302 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-8f42c40b-5862-4b61-ab89-f233fa000420 req-c0e1f092-4745-4fe8-b8a7-eb407f025803 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:46.410826 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-8f42c40b-5862-4b61-ab89-f233fa000420 req-c0e1f092-4745-4fe8-b8a7-eb407f025803 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:46.422483 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-8f42c40b-5862-4b61-ab89-f233fa000420 req-c0e1f092-4745-4fe8-b8a7-eb407f025803 service nova] Creating event network-changed:5264fc9c-9b67-46b8-b243-fb98e7e2afe8 for instance 539efdcc-6973-43c1-a734-92c87b922e4e on hv-cinder-84327 May 25 16:19:46.427763 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-8f42c40b-5862-4b61-ab89-f233fa000420 req-c0e1f092-4745-4fe8-b8a7-eb407f025803 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031447 May 25 16:19:46.428500 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 523/1033] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:19:46.549805 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-c5d9b6e6-f932-4bd9-bf8a-c11826067e7e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:46.551097 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c5d9b6e6-f932-4bd9-bf8a-c11826067e7e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:46.558315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5d9b6e6-f932-4bd9-bf8a-c11826067e7e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:46.559098 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5d9b6e6-f932-4bd9-bf8a-c11826067e7e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:46.560344 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5d9b6e6-f932-4bd9-bf8a-c11826067e7e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:46.560991 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-c5d9b6e6-f932-4bd9-bf8a-c11826067e7e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:46.593944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-c5d9b6e6-f932-4bd9-bf8a-c11826067e7e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Going to try to terminate instance {{(pid=117763) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:19:46.692834 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-c5d9b6e6-f932-4bd9-bf8a-c11826067e7e tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "DELETE /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 204 len: 0 microversion: 2.1 time: 0.145811 May 25 16:19:46.696954 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 511/1034] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:19:46 2022] DELETE /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:19:46.705159 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a44ec9a6-c38a-4a22-b52f-a2b9b50d37c4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:46.705616 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a44ec9a6-c38a-4a22-b52f-a2b9b50d37c4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:46.712168 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a44ec9a6-c38a-4a22-b52f-a2b9b50d37c4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:46.712656 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a44ec9a6-c38a-4a22-b52f-a2b9b50d37c4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:46.713720 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a44ec9a6-c38a-4a22-b52f-a2b9b50d37c4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:46.714156 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a44ec9a6-c38a-4a22-b52f-a2b9b50d37c4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:46.857455 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a44ec9a6-c38a-4a22-b52f-a2b9b50d37c4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:46.866600 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a44ec9a6-c38a-4a22-b52f-a2b9b50d37c4 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.167503 May 25 16:19:46.876060 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 524/1035] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:46 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:47.837729 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:19:47.838315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Wed May 25 16:19:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:19:47.884632 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9f35f2a4-46f6-43c8-984c-3c0337efc7ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:47.885372 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9f35f2a4-46f6-43c8-984c-3c0337efc7ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:47.892932 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f35f2a4-46f6-43c8-984c-3c0337efc7ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:47.893392 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f35f2a4-46f6-43c8-984c-3c0337efc7ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:47.894181 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f35f2a4-46f6-43c8-984c-3c0337efc7ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:47.894614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9f35f2a4-46f6-43c8-984c-3c0337efc7ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:48.031695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-9f35f2a4-46f6-43c8-984c-3c0337efc7ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:48.040160 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9f35f2a4-46f6-43c8-984c-3c0337efc7ee tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1566 microversion: 2.1 time: 0.160015 May 25 16:19:48.040740 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 512/1036] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:47 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:19:48.448929 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-82c0fc8f-964f-476b-84a8-5ae7200916cc req-8bbc9a66-3978-419f-9fb5-7d5364aa07ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17708ce9-98f7-4676-9cdd-242102969497", "tag": "5aba6c27-f5a6-468a-851f-055752b5ce50"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:19:48.457529 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-82c0fc8f-964f-476b-84a8-5ae7200916cc req-8bbc9a66-3978-419f-9fb5-7d5364aa07ee service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:48.458038 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-82c0fc8f-964f-476b-84a8-5ae7200916cc req-8bbc9a66-3978-419f-9fb5-7d5364aa07ee service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:48.469191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-82c0fc8f-964f-476b-84a8-5ae7200916cc req-8bbc9a66-3978-419f-9fb5-7d5364aa07ee service nova] Creating event network-changed:5aba6c27-f5a6-468a-851f-055752b5ce50 for instance 17708ce9-98f7-4676-9cdd-242102969497 on hv-cinder-84327 May 25 16:19:48.474146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-82c0fc8f-964f-476b-84a8-5ae7200916cc req-8bbc9a66-3978-419f-9fb5-7d5364aa07ee service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029025 May 25 16:19:48.474769 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 525/1037] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:19:49.006085 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-ee7d98d6-8f48-4eeb-be3a-5603419b51ed req-3dcbedff-2534-4992-b97f-6342d687e905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17708ce9-98f7-4676-9cdd-242102969497", "name": "network-vif-deleted", "tag": "5aba6c27-f5a6-468a-851f-055752b5ce50"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:19:49.017461 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-ee7d98d6-8f48-4eeb-be3a-5603419b51ed req-3dcbedff-2534-4992-b97f-6342d687e905 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:49.018060 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-ee7d98d6-8f48-4eeb-be3a-5603419b51ed req-3dcbedff-2534-4992-b97f-6342d687e905 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:49.022358 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:49.031291 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-ee7d98d6-8f48-4eeb-be3a-5603419b51ed req-3dcbedff-2534-4992-b97f-6342d687e905 service nova] Creating event network-vif-deleted:5aba6c27-f5a6-468a-851f-055752b5ce50 for instance 17708ce9-98f7-4676-9cdd-242102969497 on hv-cinder-84327 May 25 16:19:49.037164 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-ee7d98d6-8f48-4eeb-be3a-5603419b51ed req-3dcbedff-2534-4992-b97f-6342d687e905 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035032 May 25 16:19:49.038017 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 513/1038] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:19:49.058262 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b593bbcd-987e-4770-8d0e-3843b3ea6262 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:49.059226 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b593bbcd-987e-4770-8d0e-3843b3ea6262 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:49.066629 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b593bbcd-987e-4770-8d0e-3843b3ea6262 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:49.067249 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b593bbcd-987e-4770-8d0e-3843b3ea6262 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:49.068178 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b593bbcd-987e-4770-8d0e-3843b3ea6262 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:49.068875 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-b593bbcd-987e-4770-8d0e-3843b3ea6262 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:49.170450 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b593bbcd-987e-4770-8d0e-3843b3ea6262 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd62b4b16da4dcd8e0bdbcb6d9db3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7528adefacfc41c5a54869ec5603bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:19:49.178653 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b593bbcd-987e-4770-8d0e-3843b3ea6262 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 200 len: 1218 microversion: 2.1 time: 0.125196 May 25 16:19:49.179191 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 526/1039] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:49 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 16:19:50.201951 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:50.203102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] [instance: 17708ce9-98f7-4676-9cdd-242102969497] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:19:50.213952 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:50.214446 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:50.215346 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:19:50.215849 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:19:50.230930 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] HTTP exception thrown: Instance 17708ce9-98f7-4676-9cdd-242102969497 could not be found. May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Request method failure captured: May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 HTTP/1.1 May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlX8KObFtPJr8d88yNP361iN60rRgSYwa1yK56lbA7VoKN59cNUd4F2Vs_Vcg6rtsdY4A7TArI2A9bCujSxezRoIcdUNIXS4nCSL4wPF_Rjwhw5jNRJ3Ic14L4iOHFbMKQTuF9SwYBSxPXvOisP4e4_PzDclhtbHNGWlQ6GOYLeZe-o May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 7528adefacfc41c5a54869ec5603bde8 May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-TestShelveInstance-977913324 May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:19:50.232625 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_7528adefacfc41c5a54869ec5603bde8", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7528adefacfc41c5a54869ec5603bde8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/7528adefacfc41c5a54869ec5603bde8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/7528adefacfc41c5a54869ec5603bde8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-TestShelveInstance-977913324 May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 7528adefacfc41c5a54869ec5603bde8 May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-TestShelveInstance-977913324 May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-TestShelveInstance-977913324-project May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: abd62b4b16da4dcd8e0bdbcb6d9db3a8 May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-TestShelveInstance-977913324-project May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 17708ce9-98f7-4676-9cdd-242102969497 could not be found. May 25 16:19:50.234277 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '17708ce9-98f7-4676-9cdd-242102969497'} May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17708ce9-98f7-4676-9cdd-242102969497 could not be found. May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:19:50.235315 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17708ce9-98f7-4676-9cdd-242102969497 could not be found. May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17708ce9-98f7-4676-9cdd-242102969497 could not be found. May 25 16:19:50.236919 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:19:50.238337 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Returning 404 to user: Instance 17708ce9-98f7-4676-9cdd-242102969497 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:19:50.238337 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-34b4a6b3-7516-401a-868d-0e5c879742ce tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497" status: 404 len: 111 microversion: 2.1 time: 0.040733 May 25 16:19:50.238337 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 514/1040] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:19:50 2022] GET /compute/v2.1/servers/17708ce9-98f7-4676-9cdd-242102969497 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:19:50.417032 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0a3a141c-c8da-4705-9f22-3e052dbb6d70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] Calling method '.version_select at 0x7fbaf0128040>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:19:50.436514 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0a3a141c-c8da-4705-9f22-3e052dbb6d70 tempest-TestShelveInstance-977913324 tempest-TestShelveInstance-977913324-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-837019089" status: 202 len: 0 microversion: 2.1 time: 0.023500 May 25 16:19:50.437214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 527/1041] 10.222.0.85 () {58 vars in 1250 bytes} [Wed May 25 16:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-837019089 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:21:24.707974 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:24.708816 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:24.713627 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1966007145", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1131416181", "security_groups": [{"name": "tempest-secgroup-smoke-1645907198"}], "block_device_mapping_v2": [{"uuid": "8c5e8629-55bb-467f-8b06-d448ece89eff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8835a77f-3e24-453e-9279-13b9fbf47bf1"}]}} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:24.828826 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.network.neutron [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] validate_networks() for [('8835a77f-3e24-453e-9279-13b9fbf47bf1', None, None, None, None, None)] {{(pid=117763) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 16:21:25.218222 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Flavor limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 16:21:25.218652 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Image limits 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 16:21:25.219125 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Flavor pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 16:21:25.219533 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Image pref 0:0:0 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 16:21:25.219979 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.virt.hardware [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 16:21:25.229337 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.229781 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.230578 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:25.231016 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:25.247770 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Getting quotas for project 31462b97f7a04859b66398fd6386cfc4. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 16:21:25.251914 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.quota [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Getting quotas for user 67b7bca2e2ef4dbf89554ba2f9bf93e5 and project 31462b97f7a04859b66398fd6386cfc4. Resources: {'cores', 'ram', 'instances'} {{(pid=117763) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 16:21:25.317499 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Going to run 1 instances... {{(pid=117763) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 16:21:25.319623 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c5e8629-55bb-467f-8b06-d448ece89eff',volume_size=None,volume_type=None)] {{(pid=117763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 16:21:25.456986 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-38b74569-be0b-4bde-aa8f-572b5df9ecdf tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751087 May 25 16:21:25.457626 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 515/1042] 10.222.0.85 () {60 vars in 1146 bytes} [Wed May 25 16:21:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 16:21:25.468426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=68 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:25.470146 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:25.480859 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-b261e832-0790-4645-b8c5-6a837c9722db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:25.482000 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-b261e832-0790-4645-b8c5-6a837c9722db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:25.545214 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-b261e832-0790-4645-b8c5-6a837c9722db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:25.551970 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-b261e832-0790-4645-b8c5-6a837c9722db tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1095 microversion: 2.1 time: 0.087764 May 25 16:21:25.552640 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 528/1043] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:25 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:26.571906 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-e2607bee-8ae1-47ac-ba93-1ee578d47eed tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:26.572536 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-e2607bee-8ae1-47ac-ba93-1ee578d47eed tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:26.579984 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e2607bee-8ae1-47ac-ba93-1ee578d47eed tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.580437 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e2607bee-8ae1-47ac-ba93-1ee578d47eed tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.581201 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e2607bee-8ae1-47ac-ba93-1ee578d47eed tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:26.581655 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-e2607bee-8ae1-47ac-ba93-1ee578d47eed tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:26.650981 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-e2607bee-8ae1-47ac-ba93-1ee578d47eed tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:26.658517 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-e2607bee-8ae1-47ac-ba93-1ee578d47eed tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1211 microversion: 2.1 time: 0.092832 May 25 16:21:26.659060 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 516/1044] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:26 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:27.676268 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-0591c078-ca3e-4f65-b6c9-9d5305895c28 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:27.676849 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-0591c078-ca3e-4f65-b6c9-9d5305895c28 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:27.684114 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0591c078-ca3e-4f65-b6c9-9d5305895c28 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:27.684575 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0591c078-ca3e-4f65-b6c9-9d5305895c28 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:27.685354 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0591c078-ca3e-4f65-b6c9-9d5305895c28 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:27.685792 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-0591c078-ca3e-4f65-b6c9-9d5305895c28 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:27.900940 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-0591c078-ca3e-4f65-b6c9-9d5305895c28 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:27.908794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-0591c078-ca3e-4f65-b6c9-9d5305895c28 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.236396 May 25 16:21:27.918320 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 529/1045] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:27 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:28.118709 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-8782ba9c-2503-4906-b1e0-cc0d215c28b8 req-fd2e0a78-9171-49aa-a6bc-1ab218e64d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9123c32b-913c-428e-82fe-7be348045e44", "tag": "38fb0ca3-b448-4452-b40c-89c94abd3c4e"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:28.132386 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-8782ba9c-2503-4906-b1e0-cc0d215c28b8 req-fd2e0a78-9171-49aa-a6bc-1ab218e64d2b service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:28.133003 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-8782ba9c-2503-4906-b1e0-cc0d215c28b8 req-fd2e0a78-9171-49aa-a6bc-1ab218e64d2b service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:28.145235 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-8782ba9c-2503-4906-b1e0-cc0d215c28b8 req-fd2e0a78-9171-49aa-a6bc-1ab218e64d2b service nova] Creating event network-changed:38fb0ca3-b448-4452-b40c-89c94abd3c4e for instance 9123c32b-913c-428e-82fe-7be348045e44 on hv-cinder-84327 May 25 16:21:28.150190 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-8782ba9c-2503-4906-b1e0-cc0d215c28b8 req-fd2e0a78-9171-49aa-a6bc-1ab218e64d2b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035496 May 25 16:21:28.151210 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 517/1046] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:28.927662 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ddb9b228-d8ce-41b3-befc-ac04bbd6ab55 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:28.928339 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ddb9b228-d8ce-41b3-befc-ac04bbd6ab55 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:28.936551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddb9b228-d8ce-41b3-befc-ac04bbd6ab55 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:28.936995 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddb9b228-d8ce-41b3-befc-ac04bbd6ab55 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:28.937784 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddb9b228-d8ce-41b3-befc-ac04bbd6ab55 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:28.938217 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ddb9b228-d8ce-41b3-befc-ac04bbd6ab55 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:29.176182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-ddb9b228-d8ce-41b3-befc-ac04bbd6ab55 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:29.184648 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ddb9b228-d8ce-41b3-befc-ac04bbd6ab55 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.262185 May 25 16:21:29.185218 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 530/1047] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:28 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:30.211713 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-dde42e09-2275-441f-a7f3-073041443d46 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:30.214459 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-dde42e09-2275-441f-a7f3-073041443d46 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:30.223374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dde42e09-2275-441f-a7f3-073041443d46 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:30.223853 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dde42e09-2275-441f-a7f3-073041443d46 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:30.224694 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dde42e09-2275-441f-a7f3-073041443d46 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:30.225132 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-dde42e09-2275-441f-a7f3-073041443d46 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:30.375006 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-dde42e09-2275-441f-a7f3-073041443d46 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:30.383772 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-dde42e09-2275-441f-a7f3-073041443d46 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.184338 May 25 16:21:30.384416 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 518/1048] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:30 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:31.406432 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-af010cc5-d0b9-4d8a-a517-d925b7ea986a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:31.407450 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-af010cc5-d0b9-4d8a-a517-d925b7ea986a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:31.418622 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-af010cc5-d0b9-4d8a-a517-d925b7ea986a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:31.419356 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-af010cc5-d0b9-4d8a-a517-d925b7ea986a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:31.420653 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-af010cc5-d0b9-4d8a-a517-d925b7ea986a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:31.421361 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-af010cc5-d0b9-4d8a-a517-d925b7ea986a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:31.566120 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-af010cc5-d0b9-4d8a-a517-d925b7ea986a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:31.573916 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-af010cc5-d0b9-4d8a-a517-d925b7ea986a tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.174659 May 25 16:21:31.574474 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 531/1049] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:31 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:32.595334 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-5ab578d0-b68e-4993-8f54-bca99a3f95a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:32.596073 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-5ab578d0-b68e-4993-8f54-bca99a3f95a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:32.605127 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ab578d0-b68e-4993-8f54-bca99a3f95a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:32.605715 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ab578d0-b68e-4993-8f54-bca99a3f95a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:32.606702 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ab578d0-b68e-4993-8f54-bca99a3f95a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:32.607251 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-5ab578d0-b68e-4993-8f54-bca99a3f95a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:32.746957 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-5ab578d0-b68e-4993-8f54-bca99a3f95a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:32.755489 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-5ab578d0-b68e-4993-8f54-bca99a3f95a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.166680 May 25 16:21:32.756084 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 519/1050] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:32 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:33.776756 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-daa933ec-30e2-46fd-89b3-b660531cf44c tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:33.777669 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-daa933ec-30e2-46fd-89b3-b660531cf44c tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:33.785942 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-daa933ec-30e2-46fd-89b3-b660531cf44c tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:33.786387 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-daa933ec-30e2-46fd-89b3-b660531cf44c tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:33.787139 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-daa933ec-30e2-46fd-89b3-b660531cf44c tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:33.787566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-daa933ec-30e2-46fd-89b3-b660531cf44c tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:33.930680 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-daa933ec-30e2-46fd-89b3-b660531cf44c tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:33.939597 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-daa933ec-30e2-46fd-89b3-b660531cf44c tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.169266 May 25 16:21:33.940210 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 532/1051] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:33 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:34.958202 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-df391469-d7bd-4747-8f3c-35fa58d9e4cb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:34.958777 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-df391469-d7bd-4747-8f3c-35fa58d9e4cb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:34.965733 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-df391469-d7bd-4747-8f3c-35fa58d9e4cb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:34.966189 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-df391469-d7bd-4747-8f3c-35fa58d9e4cb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:34.966973 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-df391469-d7bd-4747-8f3c-35fa58d9e4cb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:34.967392 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-df391469-d7bd-4747-8f3c-35fa58d9e4cb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:35.102830 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-df391469-d7bd-4747-8f3c-35fa58d9e4cb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:35.110738 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-df391469-d7bd-4747-8f3c-35fa58d9e4cb tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.156564 May 25 16:21:35.111311 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 520/1052] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:34 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:36.133507 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-eac67848-a351-433d-83ef-eb9ef7af56d7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:36.134122 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-eac67848-a351-433d-83ef-eb9ef7af56d7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:36.136915 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell0:SELECT=2 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:36.142705 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-eac67848-a351-433d-83ef-eb9ef7af56d7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:36.143152 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-eac67848-a351-433d-83ef-eb9ef7af56d7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:36.143978 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-eac67848-a351-433d-83ef-eb9ef7af56d7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:36.144387 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-eac67848-a351-433d-83ef-eb9ef7af56d7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:36.286216 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-eac67848-a351-433d-83ef-eb9ef7af56d7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:36.296525 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-eac67848-a351-433d-83ef-eb9ef7af56d7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.166981 May 25 16:21:36.297205 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 533/1053] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:36 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:37.321237 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-464bb8a4-827a-4cee-aab3-6cbee8891a7e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:37.322244 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-464bb8a4-827a-4cee-aab3-6cbee8891a7e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:37.325350 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=2 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:37.326438 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell0:SELECT=6 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:37.334216 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-464bb8a4-827a-4cee-aab3-6cbee8891a7e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:37.334669 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-464bb8a4-827a-4cee-aab3-6cbee8891a7e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:37.335419 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-464bb8a4-827a-4cee-aab3-6cbee8891a7e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:37.335886 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-464bb8a4-827a-4cee-aab3-6cbee8891a7e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:37.477299 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-464bb8a4-827a-4cee-aab3-6cbee8891a7e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:37.486211 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-464bb8a4-827a-4cee-aab3-6cbee8891a7e tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.171844 May 25 16:21:37.486816 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 521/1054] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:37 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:38.074926 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-0bd4d2fb-0525-458d-aee3-cc60fed27c37 req-6eb9644e-40af-483e-bec5-25e462deea54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9123c32b-913c-428e-82fe-7be348045e44", "name": "network-vif-plugged", "status": "completed", "tag": "38fb0ca3-b448-4452-b40c-89c94abd3c4e"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:38.084881 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-0bd4d2fb-0525-458d-aee3-cc60fed27c37 req-6eb9644e-40af-483e-bec5-25e462deea54 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:38.085323 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-0bd4d2fb-0525-458d-aee3-cc60fed27c37 req-6eb9644e-40af-483e-bec5-25e462deea54 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:38.096569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-0bd4d2fb-0525-458d-aee3-cc60fed27c37 req-6eb9644e-40af-483e-bec5-25e462deea54 service nova] Creating event network-vif-plugged:38fb0ca3-b448-4452-b40c-89c94abd3c4e for instance 9123c32b-913c-428e-82fe-7be348045e44 on hv-cinder-84327 May 25 16:21:38.104612 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-0bd4d2fb-0525-458d-aee3-cc60fed27c37 req-6eb9644e-40af-483e-bec5-25e462deea54 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032898 May 25 16:21:38.105292 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 534/1055] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:21:38.509858 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-252b9e02-c5cc-4301-a3a5-797ed25dccd7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:38.510851 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-252b9e02-c5cc-4301-a3a5-797ed25dccd7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:38.522582 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-252b9e02-c5cc-4301-a3a5-797ed25dccd7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:38.523336 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-252b9e02-c5cc-4301-a3a5-797ed25dccd7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:38.524708 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-252b9e02-c5cc-4301-a3a5-797ed25dccd7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:38.525441 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-252b9e02-c5cc-4301-a3a5-797ed25dccd7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:38.665682 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-252b9e02-c5cc-4301-a3a5-797ed25dccd7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:38.676288 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-252b9e02-c5cc-4301-a3a5-797ed25dccd7 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1267 microversion: 2.1 time: 0.173407 May 25 16:21:38.676849 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 522/1056] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:38 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:39.698864 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5e4b5aad-c6cf-4b5b-aaf2-1931d2899d2f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:39.700300 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5e4b5aad-c6cf-4b5b-aaf2-1931d2899d2f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:39.709182 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5e4b5aad-c6cf-4b5b-aaf2-1931d2899d2f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:39.709636 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5e4b5aad-c6cf-4b5b-aaf2-1931d2899d2f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:39.710400 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5e4b5aad-c6cf-4b5b-aaf2-1931d2899d2f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:39.710840 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5e4b5aad-c6cf-4b5b-aaf2-1931d2899d2f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:39.849270 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5e4b5aad-c6cf-4b5b-aaf2-1931d2899d2f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:39.857860 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5e4b5aad-c6cf-4b5b-aaf2-1931d2899d2f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1454 microversion: 2.1 time: 0.166105 May 25 16:21:39.866676 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 535/1057] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:39 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:39.877980 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-29c80418-b885-4ab0-a74a-1907b8ceb799 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:21:39.878619 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-29c80418-b885-4ab0-a74a-1907b8ceb799 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:21:39.885531 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29c80418-b885-4ab0-a74a-1907b8ceb799 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:39.885999 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29c80418-b885-4ab0-a74a-1907b8ceb799 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:39.886884 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29c80418-b885-4ab0-a74a-1907b8ceb799 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:39.887374 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-29c80418-b885-4ab0-a74a-1907b8ceb799 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:40.019653 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-29c80418-b885-4ab0-a74a-1907b8ceb799 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:21:40.027769 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-29c80418-b885-4ab0-a74a-1907b8ceb799 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1454 microversion: 2.1 time: 0.154617 May 25 16:21:40.028432 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 523/1058] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:21:39 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:21:41.685277 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-8f4a7193-2e87-4e0d-93e6-8484d69f051c req-1a08b1e8-8b2d-44a0-867d-095ef6a8e8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9123c32b-913c-428e-82fe-7be348045e44", "tag": "38fb0ca3-b448-4452-b40c-89c94abd3c4e"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:21:41.694016 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-8f4a7193-2e87-4e0d-93e6-8484d69f051c req-1a08b1e8-8b2d-44a0-867d-095ef6a8e8a5 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:21:41.694551 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-8f4a7193-2e87-4e0d-93e6-8484d69f051c req-1a08b1e8-8b2d-44a0-867d-095ef6a8e8a5 service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:21:41.706756 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-8f4a7193-2e87-4e0d-93e6-8484d69f051c req-1a08b1e8-8b2d-44a0-867d-095ef6a8e8a5 service nova] Creating event network-changed:38fb0ca3-b448-4452-b40c-89c94abd3c4e for instance 9123c32b-913c-428e-82fe-7be348045e44 on hv-cinder-84327 May 25 16:21:41.711810 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-8f4a7193-2e87-4e0d-93e6-8484d69f051c req-1a08b1e8-8b2d-44a0-867d-095ef6a8e8a5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030666 May 25 16:21:41.712617 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 536/1059] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:22:55.738998 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:22:55.740281 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Wed May 25 16:22:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:23:00.386321 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:23:00.387208 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Wed May 25 16:23:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:23:07.847409 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:23:07.848433 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Wed May 25 16:23:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:23:21.350428 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:21.351355 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG dbcounter [-] [117763] Writing DB stats nova_cell1:SELECT=46 {{(pid=117763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:21.355746 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-f7973490-d5ed-42bf-8cf1-f18397e26833 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:21.356282 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f7973490-d5ed-42bf-8cf1-f18397e26833 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:21.357774 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_api:SELECT=20 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:21.358978 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG dbcounter [-] [117764] Writing DB stats nova_cell1:SELECT=40 {{(pid=117764) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:23:21.363172 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f7973490-d5ed-42bf-8cf1-f18397e26833 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:21.363666 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f7973490-d5ed-42bf-8cf1-f18397e26833 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:21.364571 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f7973490-d5ed-42bf-8cf1-f18397e26833 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:21.364939 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-f7973490-d5ed-42bf-8cf1-f18397e26833 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:21.392589 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-f7973490-d5ed-42bf-8cf1-f18397e26833 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Going to try to terminate instance {{(pid=117763) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:23:21.475126 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-f7973490-d5ed-42bf-8cf1-f18397e26833 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "DELETE /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 204 len: 0 microversion: 2.1 time: 0.126519 May 25 16:23:21.475800 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 524/1060] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:23:21 2022] DELETE /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:23:21.485390 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-37857da0-08c2-4936-82f3-5b20395fbce1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:21.485905 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-37857da0-08c2-4936-82f3-5b20395fbce1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:21.493316 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-37857da0-08c2-4936-82f3-5b20395fbce1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:21.493316 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-37857da0-08c2-4936-82f3-5b20395fbce1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:21.493963 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-37857da0-08c2-4936-82f3-5b20395fbce1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:21.494399 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-37857da0-08c2-4936-82f3-5b20395fbce1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:21.521562 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [req-6e495e93-44f4-48fe-95df-20ce577800d3 req-79b66fc3-594c-4977-9afb-e330f26127dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9123c32b-913c-428e-82fe-7be348045e44", "tag": "38fb0ca3-b448-4452-b40c-89c94abd3c4e"}]} {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:21.529897 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-6e495e93-44f4-48fe-95df-20ce577800d3 req-79b66fc3-594c-4977-9afb-e330f26127dd service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:21.530328 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [req-6e495e93-44f4-48fe-95df-20ce577800d3 req-79b66fc3-594c-4977-9afb-e330f26127dd service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:21.541839 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.compute.server_external_events [req-6e495e93-44f4-48fe-95df-20ce577800d3 req-79b66fc3-594c-4977-9afb-e330f26127dd service nova] Creating event network-changed:38fb0ca3-b448-4452-b40c-89c94abd3c4e for instance 9123c32b-913c-428e-82fe-7be348045e44 on hv-cinder-84327 May 25 16:23:21.547193 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [req-6e495e93-44f4-48fe-95df-20ce577800d3 req-79b66fc3-594c-4977-9afb-e330f26127dd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196707 May 25 16:23:21.547887 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 537/1061] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:21.686719 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-37857da0-08c2-4936-82f3-5b20395fbce1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:21.695252 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-37857da0-08c2-4936-82f3-5b20395fbce1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1579 microversion: 2.1 time: 0.213961 May 25 16:23:21.695787 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 525/1062] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:23:21 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1579 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:22.713806 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-5a9c4c60-d5a6-4dc3-a31a-6a93f21c0a53 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:22.714558 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-5a9c4c60-d5a6-4dc3-a31a-6a93f21c0a53 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:22.721904 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a9c4c60-d5a6-4dc3-a31a-6a93f21c0a53 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:22.722358 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a9c4c60-d5a6-4dc3-a31a-6a93f21c0a53 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:22.723129 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a9c4c60-d5a6-4dc3-a31a-6a93f21c0a53 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:22.723569 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-5a9c4c60-d5a6-4dc3-a31a-6a93f21c0a53 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:22.940614 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-5a9c4c60-d5a6-4dc3-a31a-6a93f21c0a53 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:22.948516 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-5a9c4c60-d5a6-4dc3-a31a-6a93f21c0a53 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1579 microversion: 2.1 time: 0.239080 May 25 16:23:22.949147 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 538/1063] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:23:22 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1579 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:23.751614 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-8e44783d-9971-420e-a473-c559e8c94430 req-fffbb535-cad5-4d54-9632-342500378f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9123c32b-913c-428e-82fe-7be348045e44", "name": "network-vif-deleted", "tag": "38fb0ca3-b448-4452-b40c-89c94abd3c4e"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:23.760761 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-8e44783d-9971-420e-a473-c559e8c94430 req-fffbb535-cad5-4d54-9632-342500378f9e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:23.761203 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-8e44783d-9971-420e-a473-c559e8c94430 req-fffbb535-cad5-4d54-9632-342500378f9e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:23.773808 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-8e44783d-9971-420e-a473-c559e8c94430 req-fffbb535-cad5-4d54-9632-342500378f9e service nova] Creating event network-vif-deleted:38fb0ca3-b448-4452-b40c-89c94abd3c4e for instance 9123c32b-913c-428e-82fe-7be348045e44 on hv-cinder-84327 May 25 16:23:23.780763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-8e44783d-9971-420e-a473-c559e8c94430 req-fffbb535-cad5-4d54-9632-342500378f9e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031736 May 25 16:23:23.781441 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 526/1064] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:23.971241 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a532f140-97f5-4e6d-9d9c-53d959307ead tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:23.972266 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a532f140-97f5-4e6d-9d9c-53d959307ead tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:23.983770 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a532f140-97f5-4e6d-9d9c-53d959307ead tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:23.984561 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a532f140-97f5-4e6d-9d9c-53d959307ead tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:23.985846 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a532f140-97f5-4e6d-9d9c-53d959307ead tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:23.986566 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a532f140-97f5-4e6d-9d9c-53d959307ead tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:24.054102 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a532f140-97f5-4e6d-9d9c-53d959307ead tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:24.076071 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a532f140-97f5-4e6d-9d9c-53d959307ead tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 200 len: 1226 microversion: 2.1 time: 0.099565 May 25 16:23:24.077176 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 539/1065] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:23:23 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:25.100152 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:25.101305 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 9123c32b-913c-428e-82fe-7be348045e44] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:25.109845 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:25.110326 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:25.111102 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:25.111534 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:25.125973 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] HTTP exception thrown: Instance 9123c32b-913c-428e-82fe-7be348045e44 could not be found. May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Request method failure captured: May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 HTTP/1.1 May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlZl2_U5qisNuCZ7wOi3t3AeRSjnU62DNT2AZcREFByH_xap352TyZiLaW5m5MykjOI5s61d4tX2M34Nmyi0pFX5qGH4VMqqjBU48_DJEwIIbcWjUwAS9kgDB_m3L9Lrs88hRILAYNEo3uvkCJDuQn32MVw_5XutcnCBF82vkVLybL0 May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:23:25.127710 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_31462b97f7a04859b66398fd6386cfc4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-TestVolumeBootPattern-1806662121-project May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 67b7bca2e2ef4dbf89554ba2f9bf93e5 May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-TestVolumeBootPattern-1806662121-project May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 9123c32b-913c-428e-82fe-7be348045e44 could not be found. May 25 16:23:25.129616 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '9123c32b-913c-428e-82fe-7be348045e44'} May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9123c32b-913c-428e-82fe-7be348045e44 could not be found. May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:23:25.130624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9123c32b-913c-428e-82fe-7be348045e44 could not be found. May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9123c32b-913c-428e-82fe-7be348045e44 could not be found. May 25 16:23:25.132484 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:25.134067 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Returning 404 to user: Instance 9123c32b-913c-428e-82fe-7be348045e44 could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:23:25.134067 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-d3c6983b-e23b-48f6-9e03-4de573b6c44f tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44" status: 404 len: 111 microversion: 2.1 time: 0.037065 May 25 16:23:25.134067 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 527/1066] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:23:25 2022] GET /compute/v2.1/servers/9123c32b-913c-428e-82fe-7be348045e44 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:23:28.291582 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-24aa0d56-1187-45b4-9338-de3ca247f3a8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:28.292827 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-8f8730ac-bf54-49c3-a0f9-8ef8b0e793df req-dc9f5c43-41ce-45e0-8034-563fb97f601a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539efdcc-6973-43c1-a734-92c87b922e4e", "tag": "5264fc9c-9b67-46b8-b243-fb98e7e2afe8"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:28.295794 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-24aa0d56-1187-45b4-9338-de3ca247f3a8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:28.302426 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-24aa0d56-1187-45b4-9338-de3ca247f3a8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:28.302628 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-8f8730ac-bf54-49c3-a0f9-8ef8b0e793df req-dc9f5c43-41ce-45e0-8034-563fb97f601a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:28.303403 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-24aa0d56-1187-45b4-9338-de3ca247f3a8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:28.304452 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-24aa0d56-1187-45b4-9338-de3ca247f3a8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:28.305012 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-24aa0d56-1187-45b4-9338-de3ca247f3a8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:28.305110 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-8f8730ac-bf54-49c3-a0f9-8ef8b0e793df req-dc9f5c43-41ce-45e0-8034-563fb97f601a service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:28.318662 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-8f8730ac-bf54-49c3-a0f9-8ef8b0e793df req-dc9f5c43-41ce-45e0-8034-563fb97f601a service nova] Creating event network-changed:5264fc9c-9b67-46b8-b243-fb98e7e2afe8 for instance 539efdcc-6973-43c1-a734-92c87b922e4e on hv-cinder-84327 May 25 16:23:28.324019 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-8f8730ac-bf54-49c3-a0f9-8ef8b0e793df req-dc9f5c43-41ce-45e0-8034-563fb97f601a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035188 May 25 16:23:28.324846 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 528/1067] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:28.334276 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-24aa0d56-1187-45b4-9338-de3ca247f3a8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Going to try to terminate instance {{(pid=117764) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 16:23:28.424176 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-24aa0d56-1187-45b4-9338-de3ca247f3a8 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "DELETE /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 204 len: 0 microversion: 2.1 time: 0.137121 May 25 16:23:28.425126 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 540/1068] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:23:28 2022] DELETE /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 16:23:28.433944 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-1068951a-8934-4d0a-a844-ecd9a2a418a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:28.434695 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-1068951a-8934-4d0a-a844-ecd9a2a418a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:28.441792 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1068951a-8934-4d0a-a844-ecd9a2a418a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:28.441964 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1068951a-8934-4d0a-a844-ecd9a2a418a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:28.443232 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1068951a-8934-4d0a-a844-ecd9a2a418a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:28.443650 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-1068951a-8934-4d0a-a844-ecd9a2a418a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:28.581636 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.policy [None req-1068951a-8934-4d0a-a844-ecd9a2a418a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117763) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:28.589535 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-1068951a-8934-4d0a-a844-ecd9a2a418a1 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1579 microversion: 2.1 time: 0.159753 May 25 16:23:28.590108 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 529/1069] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:23:28 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:29.607950 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-013aae92-b584-42f6-ba74-7e8532b31f11 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:29.608633 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-013aae92-b584-42f6-ba74-7e8532b31f11 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:29.615576 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-013aae92-b584-42f6-ba74-7e8532b31f11 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:29.616054 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-013aae92-b584-42f6-ba74-7e8532b31f11 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:29.616823 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-013aae92-b584-42f6-ba74-7e8532b31f11 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:29.617249 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-013aae92-b584-42f6-ba74-7e8532b31f11 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:29.795971 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-013aae92-b584-42f6-ba74-7e8532b31f11 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:29.804411 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-013aae92-b584-42f6-ba74-7e8532b31f11 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1579 microversion: 2.1 time: 0.201078 May 25 16:23:29.805013 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 541/1070] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:23:29 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1579 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:30.534606 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [req-d7c40434-c743-4b90-8c7a-537ca83149c0 req-b713888a-6ff1-4b2f-9798-638b64207d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539efdcc-6973-43c1-a734-92c87b922e4e", "name": "network-vif-deleted", "tag": "5264fc9c-9b67-46b8-b243-fb98e7e2afe8"}]} {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 16:23:30.543174 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-d7c40434-c743-4b90-8c7a-537ca83149c0 req-b713888a-6ff1-4b2f-9798-638b64207d9e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:30.543618 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [req-d7c40434-c743-4b90-8c7a-537ca83149c0 req-b713888a-6ff1-4b2f-9798-638b64207d9e service nova] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:30.554219 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.compute.server_external_events [req-d7c40434-c743-4b90-8c7a-537ca83149c0 req-b713888a-6ff1-4b2f-9798-638b64207d9e service nova] Creating event network-vif-deleted:5264fc9c-9b67-46b8-b243-fb98e7e2afe8 for instance 539efdcc-6973-43c1-a734-92c87b922e4e on hv-cinder-84327 May 25 16:23:30.559453 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [req-d7c40434-c743-4b90-8c7a-537ca83149c0 req-b713888a-6ff1-4b2f-9798-638b64207d9e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092249 May 25 16:23:30.560082 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 530/1071] 10.222.0.85 () {64 vars in 1317 bytes} [Wed May 25 16:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 16:23:30.822761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:30.823470 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:30.830355 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:30.830796 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:30.831557 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:30.832016 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:30.863761 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:30.864230 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:30.864690 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.objects.instance [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lazy-loading 'fault' on Instance uuid 539efdcc-6973-43c1-a734-92c87b922e4e {{(pid=117764) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 16:23:30.906148 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.policy [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b7bca2e2ef4dbf89554ba2f9bf93e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31462b97f7a04859b66398fd6386cfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117764) authorize /opt/stack/nova/nova/policy.py:199}} May 25 16:23:30.913674 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-a710832b-9958-40f9-8526-b325c9ff0856 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 200 len: 1231 microversion: 2.1 time: 0.094994 May 25 16:23:30.914259 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 542/1072] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:23:30 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 16:23:31.936876 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:31.938306 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 539efdcc-6973-43c1-a734-92c87b922e4e] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:31.950005 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:31.950898 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:31.951731 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:31.952201 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:31.965993 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] HTTP exception thrown: Instance 539efdcc-6973-43c1-a734-92c87b922e4e could not be found. May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Request method failure captured: May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e HTTP/1.1 May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlZl2_U5qisNuCZ7wOi3t3AeRSjnU62DNT2AZcREFByH_xap352TyZiLaW5m5MykjOI5s61d4tX2M34Nmyi0pFX5qGH4VMqqjBU48_DJEwIIbcWjUwAS9kgDB_m3L9Lrs88hRILAYNEo3uvkCJDuQn32MVw_5XutcnCBF82vkVLybL0 May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:23:31.967680 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_31462b97f7a04859b66398fd6386cfc4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-TestVolumeBootPattern-1806662121-project May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 67b7bca2e2ef4dbf89554ba2f9bf93e5 May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-TestVolumeBootPattern-1806662121-project May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 539efdcc-6973-43c1-a734-92c87b922e4e could not be found. May 25 16:23:31.969403 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '539efdcc-6973-43c1-a734-92c87b922e4e'} May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 539efdcc-6973-43c1-a734-92c87b922e4e could not be found. May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:23:31.970274 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 539efdcc-6973-43c1-a734-92c87b922e4e could not be found. May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 539efdcc-6973-43c1-a734-92c87b922e4e could not be found. May 25 16:23:31.972157 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:31.973649 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Returning 404 to user: Instance 539efdcc-6973-43c1-a734-92c87b922e4e could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:23:31.973649 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-9be5f7b0-9762-44ff-a9d6-688467ed9333 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e" status: 404 len: 111 microversion: 2.1 time: 0.040356 May 25 16:23:31.973649 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 531/1073] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:23:31 2022] GET /compute/v2.1/servers/539efdcc-6973-43c1-a734-92c87b922e4e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:23:32.447432 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:32.447994 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.compute.api [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117764) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:32.454782 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:32.455231 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:32.456030 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:32.456463 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG oslo_concurrency.lockutils [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117764) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:32.470591 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.wsgi [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] HTTP exception thrown: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Request method failure captured: May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: request: DELETE /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c HTTP/1.1 May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept: application/json May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Accept-Encoding: identity May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Connection: close May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Length: 0 May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Content-Type: application/json May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Host: 10.222.0.85 May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Openstack-System-Scope: None May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: User-Agent: python-urllib3/1.26.9 May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Auth-Token: gAAAAABijlZl2_U5qisNuCZ7wOi3t3AeRSjnU62DNT2AZcREFByH_xap352TyZiLaW5m5MykjOI5s61d4tX2M34Nmyi0pFX5qGH4VMqqjBU48_DJEwIIbcWjUwAS9kgDB_m3L9Lrs88hRILAYNEo3uvkCJDuQn32MVw_5XutcnCBF82vkVLybL0 May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Id: None May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Domain-Name: None May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Identity-Status: Confirmed May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Is-Admin-Project: True May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Id: default May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Domain-Name: Default May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Project-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Role: member,reader May 25 16:23:32.472301 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Roles: member,reader May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_31462b97f7a04859b66398fd6386cfc4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-Tenant-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User: tempest-TestVolumeBootPattern-1806662121-project May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Id: default May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Domain-Name: Default May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Id: 67b7bca2e2ef4dbf89554ba2f9bf93e5 May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: X-User-Name: tempest-TestVolumeBootPattern-1806662121-project May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: method: > May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: exception: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.473983 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: action_args: {'id': '20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c'} May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:23:32.474931 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.476540 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: ERROR nova.api.openstack.wsgi May 25 16:23:32.478157 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Returning 404 to user: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. {{(pid=117764) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:23:32.478157 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-ca82959e-62c0-467c-ad73-255a2cc7fb15 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "DELETE /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 404 len: 111 microversion: 2.1 time: 0.030370 May 25 16:23:32.478157 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 543/1074] 10.222.0.85 () {58 vars in 1238 bytes} [Wed May 25 16:23:32 2022] DELETE /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:23:32.482567 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '>' {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:32.483186 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.compute.api [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] [instance: 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c] Fetching instance by UUID {{(pid=117763) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 16:23:32.489391 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:32.489840 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:32.490624 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 16:23:32.491059 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG oslo_concurrency.lockutils [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Lock "f16370f5-a19e-47df-b046-12510f265b21" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 16:23:32.504610 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.wsgi [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] HTTP exception thrown: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Request method failure captured: May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: request: GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c HTTP/1.1 May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept: application/json May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Accept-Encoding: identity May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Connection: close May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Length: 0 May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Content-Type: application/json May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Host: 10.222.0.85 May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Openstack-System-Scope: None May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: User-Agent: python-urllib3/1.26.9 May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Auth-Token: gAAAAABijlZl2_U5qisNuCZ7wOi3t3AeRSjnU62DNT2AZcREFByH_xap352TyZiLaW5m5MykjOI5s61d4tX2M34Nmyi0pFX5qGH4VMqqjBU48_DJEwIIbcWjUwAS9kgDB_m3L9Lrs88hRILAYNEo3uvkCJDuQn32MVw_5XutcnCBF82vkVLybL0 May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Id: None May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Domain-Name: None May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Identity-Status: Confirmed May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Is-Admin-Project: True May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Id: default May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Domain-Name: Default May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Project-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Role: member,reader May 25 16:23:32.506100 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Roles: member,reader May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_31462b97f7a04859b66398fd6386cfc4", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/31462b97f7a04859b66398fd6386cfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}] May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Id: 31462b97f7a04859b66398fd6386cfc4 May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-Tenant-Name: tempest-TestVolumeBootPattern-1806662121 May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User: tempest-TestVolumeBootPattern-1806662121-project May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Id: default May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Domain-Name: Default May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Id: 67b7bca2e2ef4dbf89554ba2f9bf93e5 May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: X-User-Name: tempest-TestVolumeBootPattern-1806662121-project May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: method: > May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: exception: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.507766 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: action_args: {'id': '20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c'} May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: {{(pid=117763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 16:23:32.508763 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. May 25 16:23:32.510366 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: ERROR nova.api.openstack.wsgi May 25 16:23:32.512046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: DEBUG nova.api.openstack.wsgi [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Returning 404 to user: Instance 20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c could not be found. {{(pid=117763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 16:23:32.512046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO nova.api.openstack.requestlog [None req-61d8fc9f-8b02-41f6-bc23-9186a7d44484 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c" status: 404 len: 111 microversion: 2.1 time: 0.028830 May 25 16:23:32.512046 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: [pid: 117763|app: 0|req: 532/1075] 10.222.0.85 () {58 vars in 1235 bytes} [Wed May 25 16:23:32 2022] GET /compute/v2.1/servers/20ffbba2-df0d-4ffb-ac4c-e588b3a9e96c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 16:23:33.830444 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: DEBUG nova.api.openstack.wsgi [None req-c886a01f-885b-4e3a-8895-3ab3a3748346 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] Calling method '.version_select at 0x7fbae3df1f70>' {{(pid=117764) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 16:23:33.852148 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO nova.api.openstack.requestlog [None req-c886a01f-885b-4e3a-8895-3ab3a3748346 tempest-TestVolumeBootPattern-1806662121 tempest-TestVolumeBootPattern-1806662121-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1131416181" status: 202 len: 0 microversion: 2.1 time: 0.025559 May 25 16:23:33.852919 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: [pid: 117764|app: 0|req: 544/1076] 10.222.0.85 () {58 vars in 1262 bytes} [Wed May 25 16:23:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1131416181 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 16:24:44.879032 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:24:44.880093 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Wed May 25 16:24:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:26:15.753164 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:26:15.754213 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Wed May 25 16:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:26:20.399720 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:26:20.400741 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Wed May 25 16:26:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:26:27.861179 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:26:27.862169 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Wed May 25 16:26:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:26:39.290173 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:26:39.290941 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Wed May 25 16:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:26:41.212074 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:26:41.213076 dv-cinder-843277-2-iscsi devstack@n-api.service[117764]: Wed May 25 16:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 16:28:04.892764 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 16:28:04.893697 dv-cinder-843277-2-iscsi devstack@n-api.service[117763]: Wed May 25 16:28:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!